Jun 14 22:47:48.541591 ip-10-0-128-136 systemd[1]: Starting Kubernetes Kubelet... Jun 14 22:47:48.928792 ip-10-0-128-136 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:47:48.928792 ip-10-0-128-136 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 22:47:48.928792 ip-10-0-128-136 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:47:48.929865 ip-10-0-128-136 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 22:47:48.929865 ip-10-0-128-136 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:47:48.929865 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.928857 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 22:47:48.933353 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933336 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:48.933353 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933352 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933356 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933359 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933362 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933371 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933374 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933378 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933381 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933383 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933386 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933388 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933393 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933395 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933398 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933402 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933406 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933409 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933412 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933415 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933417 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:48.933420 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933420 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933423 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933426 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933429 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933432 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933434 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933437 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933440 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933443 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933446 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933449 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933452 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933455 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933458 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933460 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933463 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933466 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933469 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933472 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:48.933891 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933474 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933477 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933479 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933481 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933484 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933487 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933489 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933492 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933494 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933497 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933499 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933502 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933504 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933507 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933510 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933513 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933516 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933518 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933521 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933524 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:48.934375 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933527 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933529 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933532 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933534 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933537 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933540 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933542 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933545 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933547 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933550 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933552 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933562 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933565 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933567 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933570 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933575 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933580 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933583 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933586 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:48.934871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933589 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933591 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933594 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933597 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933599 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933602 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933604 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933607 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933610 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933613 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933616 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933618 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933621 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933623 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933626 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933630 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933633 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933636 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933639 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.933642 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:48.935341 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934386 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934393 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934396 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934398 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934402 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934405 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934408 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934410 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934414 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934417 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934419 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934422 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934426 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934429 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934431 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934434 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934437 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934439 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934442 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:48.935871 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934445 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934447 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934450 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934452 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934455 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934458 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934460 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934463 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934466 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934468 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934471 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934473 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934476 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934478 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934481 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934483 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934486 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934488 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934494 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934498 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:48.936448 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934501 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934504 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934507 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934510 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934514 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934517 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934519 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934522 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934525 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934527 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934530 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934533 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934535 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934538 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934541 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934543 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934546 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934548 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934551 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934553 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:48.936985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934558 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934562 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934565 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934567 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934570 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934573 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934577 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934581 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934584 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934587 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934590 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934593 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934596 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934599 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934602 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934604 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934607 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934610 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934612 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:48.937502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934614 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934617 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934620 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934622 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934625 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934627 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934630 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934632 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934635 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934637 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934640 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934642 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934645 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934648 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934650 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934653 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934656 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934658 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934661 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934663 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:48.937966 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.934666 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935046 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935051 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935054 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935057 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935060 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935064 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935067 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935069 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935072 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935074 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935077 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935080 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935083 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935085 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935088 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935090 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935093 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935095 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:48.938471 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935097 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935100 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935102 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935105 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935107 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935110 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935112 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935117 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935120 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935122 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935126 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935129 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935131 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935134 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935136 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935139 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935141 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935144 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935147 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935150 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:48.938938 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935152 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935155 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935157 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935160 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935162 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935165 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935168 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935172 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935176 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935179 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935182 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935184 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935187 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935190 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935193 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935195 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935198 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935201 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935204 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935208 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:48.939472 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935211 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935213 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935216 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935219 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935221 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935224 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935226 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935229 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935231 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935235 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935238 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935240 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935243 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935246 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935248 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935250 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935253 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935255 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935258 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935262 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:48.939962 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935265 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935267 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935270 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935272 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935276 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935280 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935283 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935285 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935287 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935290 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935293 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935296 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935299 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935315 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935319 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935322 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935324 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935327 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935329 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:48.940466 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935333 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.935336 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935396 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935402 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935408 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935412 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935417 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935421 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935425 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935430 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935433 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935436 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935439 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935442 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935445 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935448 2563 flags.go:64] FLAG: --cgroup-root="" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935451 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935454 2563 flags.go:64] FLAG: --client-ca-file="" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935457 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935460 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935464 2563 flags.go:64] FLAG: --cluster-domain="" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935467 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935470 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935477 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 22:47:48.940922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935481 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935484 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935487 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935490 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935494 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935497 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935499 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935502 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935505 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935508 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935512 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935515 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935518 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935521 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935524 2563 flags.go:64] FLAG: --enable-server="true" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935528 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935535 2563 flags.go:64] FLAG: --event-burst="100" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935539 2563 flags.go:64] FLAG: --event-qps="50" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935542 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935545 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935548 2563 flags.go:64] FLAG: --eviction-hard="" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935551 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935554 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935557 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935560 2563 flags.go:64] FLAG: --eviction-soft="" Jun 14 22:47:48.941526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935563 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935565 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935568 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935571 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935574 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935577 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935581 2563 flags.go:64] FLAG: --feature-gates="" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935585 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935588 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935592 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935595 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935598 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935601 2563 flags.go:64] FLAG: --help="false" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935604 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-128-136.ec2.internal" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935607 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935610 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935613 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935617 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935621 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935624 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935626 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935629 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935632 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 22:47:48.942439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935635 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935639 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935642 2563 flags.go:64] FLAG: --kube-reserved="" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935644 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935647 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935650 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935653 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935656 2563 flags.go:64] FLAG: --lock-file="" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935658 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935661 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935664 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935669 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935672 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935675 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935678 2563 flags.go:64] FLAG: --logging-format="text" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935682 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935685 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935688 2563 flags.go:64] FLAG: --manifest-url="" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935691 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935695 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935698 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935703 2563 flags.go:64] FLAG: --max-pods="110" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935706 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935709 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935711 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 22:47:48.943094 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935715 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935718 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935721 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935724 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935730 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935733 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935736 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935739 2563 flags.go:64] FLAG: --pod-cidr="" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935742 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935747 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935750 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935753 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935756 2563 flags.go:64] FLAG: --port="10250" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935759 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935762 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bff4fb8416aa42ba" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935765 2563 flags.go:64] FLAG: --qos-reserved="" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935768 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935771 2563 flags.go:64] FLAG: --register-node="true" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935774 2563 flags.go:64] FLAG: --register-with-taints="" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935777 2563 flags.go:64] FLAG: --registry-burst="10" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935780 2563 flags.go:64] FLAG: --registry-qps="5" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935783 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935786 2563 flags.go:64] FLAG: --reserved-memory="" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935791 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935794 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 22:47:48.943732 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935797 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935800 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935803 2563 flags.go:64] FLAG: --runonce="false" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935806 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935809 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935812 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935814 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935818 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935821 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935824 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935827 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935830 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935833 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935836 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935839 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935842 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935845 2563 flags.go:64] FLAG: --system-cgroups="" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935848 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935853 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935856 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935859 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935863 2563 flags.go:64] FLAG: --tls-min-version="" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935866 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935868 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935871 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 22:47:48.944368 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935874 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935877 2563 flags.go:64] FLAG: --v="2" Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935881 2563 flags.go:64] FLAG: --version="false" Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935885 2563 flags.go:64] FLAG: --vmodule="" Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935889 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.935898 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936020 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936025 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936028 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936031 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936033 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936036 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936039 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936042 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936044 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936047 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936050 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936053 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936056 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936058 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936061 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:48.944964 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936064 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936066 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936069 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936072 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936075 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936078 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936080 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936083 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936085 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936088 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936091 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936094 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936096 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936099 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936101 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936104 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936109 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936112 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936114 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936117 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:48.945501 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936120 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936123 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936125 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936128 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936130 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936133 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936136 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936138 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936141 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936143 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936146 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936149 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936151 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936154 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936156 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936159 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936163 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936165 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936169 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936172 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:48.945981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936175 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936178 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936180 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936183 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936186 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936188 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936191 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936193 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936198 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936201 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936203 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936206 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936208 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936211 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936214 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936216 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936219 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936222 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936224 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936227 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:48.946502 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936229 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936232 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936234 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936237 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936240 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936242 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936245 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936247 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936250 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936253 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936255 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936259 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936263 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936266 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936268 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936271 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936273 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936277 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936280 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:48.946985 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936283 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936289 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936292 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936295 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.936297 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.936316 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944017 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944033 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944054 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944066 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944126 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944133 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944136 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944139 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:48.947515 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944143 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944146 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944149 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944151 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944154 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944157 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944160 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944163 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944165 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944168 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944170 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944173 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944175 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944178 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944182 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944186 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944189 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944192 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944195 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:48.947875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944200 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944204 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944208 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944213 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944217 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944219 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944223 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944226 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944229 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944232 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944234 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944237 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944240 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944243 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944246 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944248 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944251 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944253 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944256 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944259 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:48.948493 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944262 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944264 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944267 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944270 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944273 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944277 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944282 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944288 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944293 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944296 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944299 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944313 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944316 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944318 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944321 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944324 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944326 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944329 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944333 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:48.948977 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944337 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944341 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944344 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944347 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944349 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944352 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944357 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944361 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944365 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944370 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944373 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944375 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944378 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944381 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944383 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944386 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944389 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944393 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944395 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944398 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:48.949467 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944400 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944403 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944406 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944409 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944411 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944414 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944416 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944419 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944422 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944424 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944427 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944430 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944433 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944437 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944441 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944446 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:48.949957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944450 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944455 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944571 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944577 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944581 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944584 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944587 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944589 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944593 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944598 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944602 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944606 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944610 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944612 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944615 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:47:48.950373 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944618 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944621 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944624 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944626 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944629 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944631 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944634 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944637 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944639 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944642 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944644 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944647 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944649 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944652 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944654 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944657 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944660 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944662 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944665 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944667 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:47:48.950746 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944670 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944675 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944679 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944684 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944690 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944693 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944696 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944699 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944702 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944704 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944707 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944709 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944712 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944715 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944717 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944720 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944723 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944725 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944728 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:47:48.951221 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944730 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944733 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944736 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944738 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944741 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944743 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944746 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944748 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944752 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944756 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944760 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944764 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944768 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944771 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944774 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944776 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944779 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944783 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944786 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944789 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:47:48.951756 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944792 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944794 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944797 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944800 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944802 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944805 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944808 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944811 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944813 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944816 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944818 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944821 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944823 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944826 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944829 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944834 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944838 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944842 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944847 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944850 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:47:48.952261 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944852 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944855 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944857 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944860 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944862 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944869 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:48.944873 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944878 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.944989 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.949508 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.950955 2563 server.go:1019] "Starting client certificate rotation" Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.951050 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 22:47:48.952757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.951826 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 22:47:48.954483 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.954470 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 22:47:48.959470 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.959454 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 22:47:48.969791 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.969769 2563 log.go:25] "Validated CRI v1 runtime API" Jun 14 22:47:48.973126 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.973109 2563 log.go:25] "Validated CRI v1 image API" Jun 14 22:47:48.973884 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.973866 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 22:47:48.977561 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.977537 2563 fs.go:135] Filesystem UUIDs: map[0efca662-4c81-4dd8-ad38-e6082151939b:/dev/nvme0n1p3 3745e82a-4872-4ea9-836e-502033a5178e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 14 22:47:48.977630 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.977560 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 22:47:48.981670 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.981651 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 22:47:48.984528 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.984425 2563 manager.go:216] Machine: {Timestamp:2026-06-14 22:47:48.983218566 +0000 UTC m=+0.326608384 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103207 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262c93a04e5cf7de1721ebfd85fc9b SystemUUID:ec262c93-a04e-5cf7-de17-21ebfd85fc9b BootID:55c65233-09c0-40b9-bd8d-67f3697d204d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:21:a4:04:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:21:a4:04:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:55:6d:54:88:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 22:47:48.984528 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.984520 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 22:47:48.984658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.984601 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 22:47:48.988225 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.988200 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 22:47:48.988376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.988228 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 22:47:48.989561 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.989551 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 22:47:48.989593 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.989564 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 22:47:48.989593 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.989572 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 22:47:48.990260 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.990251 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 22:47:48.991604 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.991595 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 22:47:48.994335 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994324 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 14 22:47:48.994454 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994445 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 22:47:48.994491 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994476 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 14 22:47:48.994491 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994488 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 22:47:48.994548 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994506 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 22:47:48.994548 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994519 2563 kubelet.go:398] "Adding apiserver pod source" Jun 14 22:47:48.994548 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994529 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 22:47:48.994883 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994869 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 22:47:48.994934 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.994891 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 22:47:48.996973 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.996954 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 22:47:48.998201 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998188 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 22:47:48.998256 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998219 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 22:47:48.998409 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998399 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 22:47:48.998441 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998414 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 22:47:48.998441 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998421 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 22:47:48.998441 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998426 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 22:47:48.998441 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998436 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 22:47:48.998553 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998445 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 22:47:48.998895 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998886 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 22:47:48.998929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998896 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 22:47:48.998929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998903 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 22:47:48.998929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998909 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 22:47:48.998929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998917 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 22:47:48.998929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:48.998925 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 22:47:49.000433 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.000420 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 22:47:49.000433 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.000433 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 22:47:49.001662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.001643 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5cb5n" Jun 14 22:47:49.003796 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.003784 2563 server.go:1268] "Started kubelet" Jun 14 22:47:49.003943 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.003894 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 22:47:49.004021 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.003958 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 22:47:49.004069 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.004019 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 22:47:49.004756 ip-10-0-128-136 systemd[1]: Started Kubernetes Kubelet. Jun 14 22:47:49.005723 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.005546 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 22:47:49.005723 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.005571 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 22:47:49.005723 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.005592 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 22:47:49.005872 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.005806 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 22:47:49.006317 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.006292 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 14 22:47:49.009183 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.009139 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5cb5n" Jun 14 22:47:49.010985 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.010964 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 22:47:49.012096 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.011175 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-136.ec2.internal.18b914233266e036 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-136.ec2.internal,UID:ip-10-0-128-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-136.ec2.internal,},FirstTimestamp:2026-06-14 22:47:49.003755574 +0000 UTC m=+0.347145391,LastTimestamp:2026-06-14 22:47:49.003755574 +0000 UTC m=+0.347145391,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-136.ec2.internal,}" Jun 14 22:47:49.012352 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.012335 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 22:47:49.012455 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.012405 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 22:47:49.012536 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.012478 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.012958 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.012943 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 22:47:49.013286 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013262 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 22:47:49.013385 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013351 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 22:47:49.013514 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013499 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 14 22:47:49.013514 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013511 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 14 22:47:49.013706 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013587 2563 factory.go:55] Registering systemd factory Jun 14 22:47:49.013706 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013604 2563 factory.go:223] Registration of the systemd container factory successfully Jun 14 22:47:49.013822 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013814 2563 factory.go:153] Registering CRI-O factory Jun 14 22:47:49.013869 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.013828 2563 factory.go:223] Registration of the crio container factory successfully Jun 14 22:47:49.014104 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.014085 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 22:47:49.014187 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.014116 2563 factory.go:103] Registering Raw factory Jun 14 22:47:49.014187 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.014133 2563 manager.go:1196] Started watching for new ooms in manager Jun 14 22:47:49.014564 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.014539 2563 manager.go:349] Starting recovery of all containers Jun 14 22:47:49.020095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.019972 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:49.022572 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.022552 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-136.ec2.internal\" not found" node="ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.023279 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.023268 2563 manager.go:354] Recovery completed Jun 14 22:47:49.028559 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.028545 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.030383 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.030368 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.030458 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.030400 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.030458 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.030414 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.030932 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.030919 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 22:47:49.030932 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.030930 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.031010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.030932 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 22:47:49.031010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.031000 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 14 22:47:49.031592 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.031578 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.031652 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.031603 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.031652 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.031612 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.032210 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.032198 2563 policy_none.go:49] "None policy: Start" Jun 14 22:47:49.032244 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.032213 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 22:47:49.032244 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.032222 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 22:47:49.033110 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.033100 2563 policy_none.go:47] "Start" Jun 14 22:47:49.070962 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.070949 2563 manager.go:337] "Starting Device Plugin manager" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.070988 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.071002 2563 server.go:87] "Starting device plugin registration server" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.071259 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.071271 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.071373 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.071451 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.071460 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.071975 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.072029 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.082683 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.083879 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.083940 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.084020 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.084105 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 22:47:49.086672 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.086097 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:49.172353 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.172318 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.173451 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.173434 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.173555 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.173469 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.173555 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.173485 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.173555 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.173516 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.179556 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.179512 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.179556 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.179534 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-136.ec2.internal\": node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.184587 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.184568 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal"] Jun 14 22:47:49.184649 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.184626 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.185401 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.185387 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.185462 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.185414 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.185462 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.185424 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.186577 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.186566 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.186694 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.186680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.186746 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.186714 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.187215 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.187201 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.187287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.187223 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.187287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.187235 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.187287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.187239 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.187287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.187261 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.187287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.187274 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.188341 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.188326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.188417 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.188355 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:47:49.189028 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.189012 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:47:49.189090 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.189035 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:47:49.189090 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.189051 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:47:49.190665 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.190651 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.214922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.214897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43d43933e113029bd040b626c0b9543c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-136.ec2.internal\" (UID: \"43d43933e113029bd040b626c0b9543c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.215005 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.214924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6574df0fbbcf2e9ad2074fbcad86a366-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"6574df0fbbcf2e9ad2074fbcad86a366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.215005 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.214942 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-136.ec2.internal\" not found" node="ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.215005 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.214940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6574df0fbbcf2e9ad2074fbcad86a366-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"6574df0fbbcf2e9ad2074fbcad86a366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.219363 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.219348 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-136.ec2.internal\" not found" node="ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.291457 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.291436 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.315615 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.315585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6574df0fbbcf2e9ad2074fbcad86a366-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"6574df0fbbcf2e9ad2074fbcad86a366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.315734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.315620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6574df0fbbcf2e9ad2074fbcad86a366-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"6574df0fbbcf2e9ad2074fbcad86a366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.315734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.315644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43d43933e113029bd040b626c0b9543c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-136.ec2.internal\" (UID: \"43d43933e113029bd040b626c0b9543c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.315734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.315682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6574df0fbbcf2e9ad2074fbcad86a366-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"6574df0fbbcf2e9ad2074fbcad86a366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.315734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.315692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43d43933e113029bd040b626c0b9543c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-136.ec2.internal\" (UID: \"43d43933e113029bd040b626c0b9543c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.315734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.315694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6574df0fbbcf2e9ad2074fbcad86a366-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"6574df0fbbcf2e9ad2074fbcad86a366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.392273 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.392240 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.492920 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.492846 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.517335 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.517293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.523345 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.523325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jun 14 22:47:49.593937 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.593903 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.694388 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.694358 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.794909 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.794829 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.895298 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.895276 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:49.950774 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.950747 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 22:47:49.951414 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.950916 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 22:47:49.951414 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.950944 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 22:47:49.981981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:49.981954 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6574df0fbbcf2e9ad2074fbcad86a366.slice/crio-1e24e79c3b68d11885d2fc005354512db8c78a25e605dee4931fbd74f950b8f0 WatchSource:0}: Error finding container 1e24e79c3b68d11885d2fc005354512db8c78a25e605dee4931fbd74f950b8f0: Status 404 returned error can't find the container with id 1e24e79c3b68d11885d2fc005354512db8c78a25e605dee4931fbd74f950b8f0 Jun 14 22:47:49.982230 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:49.982208 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d43933e113029bd040b626c0b9543c.slice/crio-ad011b6f151b720241cb57ac166c381be3bc82e3e2bcad5ff590d71b732995ed WatchSource:0}: Error finding container ad011b6f151b720241cb57ac166c381be3bc82e3e2bcad5ff590d71b732995ed: Status 404 returned error can't find the container with id ad011b6f151b720241cb57ac166c381be3bc82e3e2bcad5ff590d71b732995ed Jun 14 22:47:49.986222 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:49.986209 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:47:49.995816 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:49.995797 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:50.013891 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.013862 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 22:42:49 +0000 UTC" deadline="2028-02-01 19:42:25.544538601 +0000 UTC" Jun 14 22:47:50.013891 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.013884 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14324h54m35.530656898s" Jun 14 22:47:50.087485 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.087382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" event={"ID":"43d43933e113029bd040b626c0b9543c","Type":"ContainerStarted","Data":"ad011b6f151b720241cb57ac166c381be3bc82e3e2bcad5ff590d71b732995ed"} Jun 14 22:47:50.088356 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.088334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" event={"ID":"6574df0fbbcf2e9ad2074fbcad86a366","Type":"ContainerStarted","Data":"1e24e79c3b68d11885d2fc005354512db8c78a25e605dee4931fbd74f950b8f0"} Jun 14 22:47:50.096524 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:50.096511 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:50.196962 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:50.196931 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jun 14 22:47:50.221696 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.221675 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:50.313704 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.313677 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jun 14 22:47:50.323521 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.323494 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 22:47:50.325269 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.325249 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jun 14 22:47:50.336097 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.336075 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 22:47:50.439633 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.439606 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:50.862821 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.862747 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:50.988720 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.988685 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:47:50.995691 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:50.995668 2563 apiserver.go:52] "Watching apiserver" Jun 14 22:47:51.005330 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.005288 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 22:47:51.005676 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.005652 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-ztgxq","openshift-network-operator/iptables-alerter-xzw9c","openshift-ovn-kubernetes/ovnkube-node-hqn78","kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq","openshift-cluster-node-tuning-operator/tuned-ttcpk","openshift-dns/node-resolver-n6jf4","openshift-image-registry/node-ca-wx6bp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal","openshift-multus/multus-additional-cni-plugins-c29ds","openshift-multus/multus-pgfrr","kube-system/global-pull-secret-syncer-fzztj","kube-system/konnectivity-agent-f244d","openshift-multus/network-metrics-daemon-m479d"] Jun 14 22:47:51.007162 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.007099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.008396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.008377 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.009954 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.009533 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.009954 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.009779 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s88pl\"" Jun 14 22:47:51.009954 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.009785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.009954 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.009874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 22:47:51.010209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.009996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 22:47:51.010209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.010021 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 22:47:51.010209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.010085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.011207 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.011189 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.011328 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.011255 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:47:51.011328 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.011272 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 22:47:51.011440 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.011339 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 22:47:51.011440 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.011356 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wvpl7\"" Jun 14 22:47:51.012319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.012197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zf6tz\"" Jun 14 22:47:51.012319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.012213 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 22:47:51.012319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.012232 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.012977 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.012953 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 22:47:51.013165 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.013146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.014555 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.014537 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 22:47:51.014650 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.014589 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.016377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.014933 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 22:47:51.016377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.015148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.016377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.015277 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 22:47:51.016377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.015559 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.016377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.016196 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wrnvf\"" Jun 14 22:47:51.016377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.016329 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 22:47:51.017553 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.017367 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.017644 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.017596 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kp258\"" Jun 14 22:47:51.017644 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.017615 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.017745 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.017640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.017929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.017901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.018763 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.018746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.019640 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.019624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 22:47:51.020035 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.020017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.020134 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.020069 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.020134 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.020107 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.020246 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.020164 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ftcht\"" Jun 14 22:47:51.021073 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.021055 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.021319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.021286 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5ls4d\"" Jun 14 22:47:51.021507 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.021493 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.022288 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.022271 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:47:51.022382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.022270 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 22:47:51.022382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.022338 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 22:47:51.022463 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.022455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rccg\"" Jun 14 22:47:51.022724 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.022704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:51.022826 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.022779 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:47:51.023968 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.023951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.024484 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.024463 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 22:47:51.025353 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.025293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.025473 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.025395 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:47:51.026048 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026133 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b47ea593-22a5-4604-a8ce-215d83678696-etc-tuned\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.026133 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026080 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 22:47:51.026133 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.026133 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkwlm\" (UniqueName: \"kubernetes.io/projected/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-kube-api-access-qkwlm\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-slash\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-log-socket\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6snj\"" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-cni-netd\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cni-binary-copy\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.026362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9tmw\" (UniqueName: \"kubernetes.io/projected/5c794efc-df60-4a85-92fb-9ca2f9328997-kube-api-access-x9tmw\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9335656f-8c59-4678-b37e-b0c6401a867f-agent-certs\") pod \"konnectivity-agent-f244d\" (UID: \"9335656f-8c59-4678-b37e-b0c6401a867f\") " pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-kubelet\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-node-log\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-ovnkube-config\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47ea593-22a5-4604-a8ce-215d83678696-tmp\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-systemd-units\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-systemd\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-cni-bin\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-ovnkube-script-lib\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mclj\" (UniqueName: \"kubernetes.io/projected/d9544096-962a-4427-a374-55e65cdee292-kube-api-access-8mclj\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.026701 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-run\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjv8l\" (UniqueName: \"kubernetes.io/projected/b47ea593-22a5-4604-a8ce-215d83678696-kube-api-access-jjv8l\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-env-overrides\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqjxx\" (UniqueName: \"kubernetes.io/projected/61ff5caf-e213-4186-9860-81bd8ad721f9-kube-api-access-zqjxx\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-systemd\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-var-lib-kubelet\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cnibin\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026933 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-etc-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.026997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-socket-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-device-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-modprobe-d\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysctl-conf\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-sys\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.027283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-run-netns\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-ovn\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-registration-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-sys-fs\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-host\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-system-cni-dir\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-os-release\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9335656f-8c59-4678-b37e-b0c6401a867f-konnectivity-ca\") pod \"konnectivity-agent-f244d\" (UID: \"9335656f-8c59-4678-b37e-b0c6401a867f\") " pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-var-lib-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c794efc-df60-4a85-92fb-9ca2f9328997-ovn-node-metrics-cert\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysconfig\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-kubernetes\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysctl-d\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.028060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.027468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-lib-modules\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.042071 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.042032 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nj6b6" Jun 14 22:47:51.049159 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.049139 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nj6b6" Jun 14 22:47:51.114739 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.114670 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 22:47:51.128220 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2285496-6eda-4c2c-8268-1c79a6c5b035-kubelet-config\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.128220 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-systemd\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.128461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.128461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-systemd\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.128461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22194b3e-c52c-4b11-ab07-e82ffee15eb8-tmp-dir\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.128461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-cnibin\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-os-release\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-cni-bin\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128532 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-daemon-config\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-socket-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-device-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-device-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-modprobe-d\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-socket-dir-parent\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-socket-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-ovn\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-ovn\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-registration-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-sys-fs\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-registration-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-modprobe-d\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.128800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-system-cni-dir\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cni-binary-copy\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-etc-kubernetes\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-system-cni-dir\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-sys-fs\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-iptables-alerter-script\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.128988 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9335656f-8c59-4678-b37e-b0c6401a867f-konnectivity-ca\") pod \"konnectivity-agent-f244d\" (UID: \"9335656f-8c59-4678-b37e-b0c6401a867f\") " pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-var-lib-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c794efc-df60-4a85-92fb-9ca2f9328997-ovn-node-metrics-cert\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysconfig\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-lib-modules\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-var-lib-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.129323 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-cni-binary-copy\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.129573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-cni-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-lib-modules\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cni-binary-copy\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-kubelet\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysconfig\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.129551 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:51.629509697 +0000 UTC m=+2.972899507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-conf-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-slash\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xtg\" (UniqueName: \"kubernetes.io/projected/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-kube-api-access-q4xtg\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9335656f-8c59-4678-b37e-b0c6401a867f-konnectivity-ca\") pod \"konnectivity-agent-f244d\" (UID: \"9335656f-8c59-4678-b37e-b0c6401a867f\") " pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9335656f-8c59-4678-b37e-b0c6401a867f-agent-certs\") pod \"konnectivity-agent-f244d\" (UID: \"9335656f-8c59-4678-b37e-b0c6401a867f\") " pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129714 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-slash\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129697 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-kubelet\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.130252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-kubelet\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-node-log\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6td8\" (UniqueName: \"kubernetes.io/projected/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-kube-api-access-j6td8\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-host-slash\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-systemd-units\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-node-log\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-ovnkube-script-lib\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mclj\" (UniqueName: \"kubernetes.io/projected/d9544096-962a-4427-a374-55e65cdee292-kube-api-access-8mclj\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.129997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-systemd-units\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-run\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22194b3e-c52c-4b11-ab07-e82ffee15eb8-hosts-file\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130079 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-run\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-hostroot\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-env-overrides\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqjxx\" (UniqueName: \"kubernetes.io/projected/61ff5caf-e213-4186-9860-81bd8ad721f9-kube-api-access-zqjxx\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-var-lib-kubelet\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cnibin\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-var-lib-kubelet\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dm5q\" (UniqueName: \"kubernetes.io/projected/22194b3e-c52c-4b11-ab07-e82ffee15eb8-kube-api-access-5dm5q\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cnibin\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-multus-certs\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-etc-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysctl-conf\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-etc-openvswitch\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-sys\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-host\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-serviceca\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-run-netns\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-sys\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9544096-962a-4427-a374-55e65cdee292-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.131925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-os-release\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130603 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-host\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-env-overrides\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-host\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-run-netns\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2285496-6eda-4c2c-8268-1c79a6c5b035-dbus\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-os-release\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-kubernetes\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysctl-d\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkwlm\" (UniqueName: \"kubernetes.io/projected/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-kube-api-access-qkwlm\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-kubernetes\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-netns\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b47ea593-22a5-4604-a8ce-215d83678696-etc-tuned\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-cni-multus\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysctl-d\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.132580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5sm\" (UniqueName: \"kubernetes.io/projected/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-kube-api-access-rf5sm\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-log-socket\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-cni-netd\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.130984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9tmw\" (UniqueName: \"kubernetes.io/projected/5c794efc-df60-4a85-92fb-9ca2f9328997-kube-api-access-x9tmw\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-log-socket\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-cni-netd\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-ovnkube-config\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47ea593-22a5-4604-a8ce-215d83678696-tmp\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-k8s-cni-cncf-io\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131135 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-ovnkube-script-lib\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-systemd\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-cni-bin\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131183 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjv8l\" (UniqueName: \"kubernetes.io/projected/b47ea593-22a5-4604-a8ce-215d83678696-kube-api-access-jjv8l\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-system-cni-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.133378 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-run-systemd\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.134209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131293 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c794efc-df60-4a85-92fb-9ca2f9328997-host-cni-bin\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.134209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b47ea593-22a5-4604-a8ce-215d83678696-etc-sysctl-conf\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.134209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.131520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c794efc-df60-4a85-92fb-9ca2f9328997-ovnkube-config\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.134209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.133370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47ea593-22a5-4604-a8ce-215d83678696-tmp\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.134209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.133481 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c794efc-df60-4a85-92fb-9ca2f9328997-ovn-node-metrics-cert\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.134209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.133591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9335656f-8c59-4678-b37e-b0c6401a867f-agent-certs\") pod \"konnectivity-agent-f244d\" (UID: \"9335656f-8c59-4678-b37e-b0c6401a867f\") " pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.134653 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.134626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b47ea593-22a5-4604-a8ce-215d83678696-etc-tuned\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.142043 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.142020 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mclj\" (UniqueName: \"kubernetes.io/projected/d9544096-962a-4427-a374-55e65cdee292-kube-api-access-8mclj\") pod \"aws-ebs-csi-driver-node-vmqjq\" (UID: \"d9544096-962a-4427-a374-55e65cdee292\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.142590 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.142563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqjxx\" (UniqueName: \"kubernetes.io/projected/61ff5caf-e213-4186-9860-81bd8ad721f9-kube-api-access-zqjxx\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.142854 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.142831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkwlm\" (UniqueName: \"kubernetes.io/projected/94011f2d-9bdb-4eda-a7cb-a38279ec0deb-kube-api-access-qkwlm\") pod \"multus-additional-cni-plugins-c29ds\" (UID: \"94011f2d-9bdb-4eda-a7cb-a38279ec0deb\") " pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.143329 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.143282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9tmw\" (UniqueName: \"kubernetes.io/projected/5c794efc-df60-4a85-92fb-9ca2f9328997-kube-api-access-x9tmw\") pod \"ovnkube-node-hqn78\" (UID: \"5c794efc-df60-4a85-92fb-9ca2f9328997\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.143460 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.143436 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjv8l\" (UniqueName: \"kubernetes.io/projected/b47ea593-22a5-4604-a8ce-215d83678696-kube-api-access-jjv8l\") pod \"tuned-ttcpk\" (UID: \"b47ea593-22a5-4604-a8ce-215d83678696\") " pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.231780 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.231746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-host\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.231780 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.231783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2285496-6eda-4c2c-8268-1c79a6c5b035-dbus\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.231805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.231875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-host\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.231918 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.231948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-netns\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.231982 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:51.731961565 +0000 UTC m=+3.075351383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.231993 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2285496-6eda-4c2c-8268-1c79a6c5b035-dbus\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.232029 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-cni-multus\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5sm\" (UniqueName: \"kubernetes.io/projected/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-kube-api-access-rf5sm\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-netns\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-k8s-cni-cncf-io\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-system-cni-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-cni-multus\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2285496-6eda-4c2c-8268-1c79a6c5b035-kubelet-config\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-k8s-cni-cncf-io\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22194b3e-c52c-4b11-ab07-e82ffee15eb8-tmp-dir\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-cnibin\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-system-cni-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-os-release\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-cnibin\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-cni-bin\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2285496-6eda-4c2c-8268-1c79a6c5b035-kubelet-config\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-cni-bin\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.232387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-daemon-config\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-socket-dir-parent\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-etc-kubernetes\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-iptables-alerter-script\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-os-release\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-cni-binary-copy\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-etc-kubernetes\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-socket-dir-parent\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-cni-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232559 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22194b3e-c52c-4b11-ab07-e82ffee15eb8-tmp-dir\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-kubelet\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-cni-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-conf-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xtg\" (UniqueName: \"kubernetes.io/projected/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-kube-api-access-q4xtg\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-var-lib-kubelet\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6td8\" (UniqueName: \"kubernetes.io/projected/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-kube-api-access-j6td8\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-conf-dir\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-host-slash\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.233118 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22194b3e-c52c-4b11-ab07-e82ffee15eb8-hosts-file\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-hostroot\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dm5q\" (UniqueName: \"kubernetes.io/projected/22194b3e-c52c-4b11-ab07-e82ffee15eb8-kube-api-access-5dm5q\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-multus-certs\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-serviceca\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232912 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-multus-daemon-config\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-hostroot\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-host-run-multus-certs\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.232984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-cni-binary-copy\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.233009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-host-slash\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.233040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22194b3e-c52c-4b11-ab07-e82ffee15eb8-hosts-file\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.233097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-iptables-alerter-script\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.233812 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.233461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-serviceca\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.238655 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.238634 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:51.238655 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.238658 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:51.238823 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.238670 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:51.238823 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.238763 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:51.738745602 +0000 UTC m=+3.082135423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:51.242576 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.241201 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5sm\" (UniqueName: \"kubernetes.io/projected/6b06b7bd-b307-48e4-81d8-d90ad3d7491f-kube-api-access-rf5sm\") pod \"iptables-alerter-xzw9c\" (UID: \"6b06b7bd-b307-48e4-81d8-d90ad3d7491f\") " pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.242576 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.241225 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xtg\" (UniqueName: \"kubernetes.io/projected/c6467c97-cfb8-4a9b-bac4-f61d0c73cacf-kube-api-access-q4xtg\") pod \"node-ca-wx6bp\" (UID: \"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf\") " pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.243409 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.243373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dm5q\" (UniqueName: \"kubernetes.io/projected/22194b3e-c52c-4b11-ab07-e82ffee15eb8-kube-api-access-5dm5q\") pod \"node-resolver-n6jf4\" (UID: \"22194b3e-c52c-4b11-ab07-e82ffee15eb8\") " pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.243409 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.243379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6td8\" (UniqueName: \"kubernetes.io/projected/e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a-kube-api-access-j6td8\") pod \"multus-pgfrr\" (UID: \"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a\") " pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.322854 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.322818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c29ds" Jun 14 22:47:51.331708 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.331686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f244d" Jun 14 22:47:51.339318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.339290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:47:51.346059 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.346042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" Jun 14 22:47:51.351589 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.351570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" Jun 14 22:47:51.358188 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.358169 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wx6bp" Jun 14 22:47:51.363731 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.363714 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6jf4" Jun 14 22:47:51.370164 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.370146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzw9c" Jun 14 22:47:51.377683 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.377659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pgfrr" Jun 14 22:47:51.634923 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.634838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:51.635082 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.634981 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:51.635082 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.635038 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:52.635021528 +0000 UTC m=+3.978411334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:51.735461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.735436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:51.735567 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.735535 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:51.735605 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.735583 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:52.735570589 +0000 UTC m=+4.078960392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:51.763043 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.762833 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9335656f_8c59_4678_b37e_b0c6401a867f.slice/crio-0fe6d36edf22389d5f26bc1c4fd5d4e3c41070dcfb185ac30181224e53d9824d WatchSource:0}: Error finding container 0fe6d36edf22389d5f26bc1c4fd5d4e3c41070dcfb185ac30181224e53d9824d: Status 404 returned error can't find the container with id 0fe6d36edf22389d5f26bc1c4fd5d4e3c41070dcfb185ac30181224e53d9824d Jun 14 22:47:51.764970 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.764943 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b06b7bd_b307_48e4_81d8_d90ad3d7491f.slice/crio-e28d10b9eb9a4646d281a02c9abe59c2a28261a90039cce27691006e23a0a97c WatchSource:0}: Error finding container e28d10b9eb9a4646d281a02c9abe59c2a28261a90039cce27691006e23a0a97c: Status 404 returned error can't find the container with id e28d10b9eb9a4646d281a02c9abe59c2a28261a90039cce27691006e23a0a97c Jun 14 22:47:51.768957 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.768935 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6467c97_cfb8_4a9b_bac4_f61d0c73cacf.slice/crio-f69270fdb98c670cc73fe75f3b2e7245522e23f255b09191dea5f25b0ad39ae5 WatchSource:0}: Error finding container f69270fdb98c670cc73fe75f3b2e7245522e23f255b09191dea5f25b0ad39ae5: Status 404 returned error can't find the container with id f69270fdb98c670cc73fe75f3b2e7245522e23f255b09191dea5f25b0ad39ae5 Jun 14 22:47:51.769919 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.769894 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c794efc_df60_4a85_92fb_9ca2f9328997.slice/crio-fc9bb10506827d2410c7069de196f43860b6e59e12943c5aeba6ef480976d6d8 WatchSource:0}: Error finding container fc9bb10506827d2410c7069de196f43860b6e59e12943c5aeba6ef480976d6d8: Status 404 returned error can't find the container with id fc9bb10506827d2410c7069de196f43860b6e59e12943c5aeba6ef480976d6d8 Jun 14 22:47:51.770854 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.770829 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47ea593_22a5_4604_a8ce_215d83678696.slice/crio-1cd07f562ce546c965c6ed7bf8fa9f8943847ef7b737b574b5e368d85bcd7629 WatchSource:0}: Error finding container 1cd07f562ce546c965c6ed7bf8fa9f8943847ef7b737b574b5e368d85bcd7629: Status 404 returned error can't find the container with id 1cd07f562ce546c965c6ed7bf8fa9f8943847ef7b737b574b5e368d85bcd7629 Jun 14 22:47:51.771858 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.771808 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94011f2d_9bdb_4eda_a7cb_a38279ec0deb.slice/crio-89d03f0cf8bbf56828c9816d18ec6f282bb32fc30784838cc0db8170165b9d72 WatchSource:0}: Error finding container 89d03f0cf8bbf56828c9816d18ec6f282bb32fc30784838cc0db8170165b9d72: Status 404 returned error can't find the container with id 89d03f0cf8bbf56828c9816d18ec6f282bb32fc30784838cc0db8170165b9d72 Jun 14 22:47:51.773089 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:47:51.772765 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22194b3e_c52c_4b11_ab07_e82ffee15eb8.slice/crio-8d716f7190d3ce8455bf07929553a040cc0b9406308d6b1968aef33af6dde0c2 WatchSource:0}: Error finding container 8d716f7190d3ce8455bf07929553a040cc0b9406308d6b1968aef33af6dde0c2: Status 404 returned error can't find the container with id 8d716f7190d3ce8455bf07929553a040cc0b9406308d6b1968aef33af6dde0c2 Jun 14 22:47:51.835905 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:51.835881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:51.836023 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.836011 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:51.836060 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.836029 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:51.836060 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.836037 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:51.836129 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:51.836080 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:52.836068583 +0000 UTC m=+4.179458386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:52.050735 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.050675 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 22:42:51 +0000 UTC" deadline="2028-03-20 03:44:21.716416468 +0000 UTC" Jun 14 22:47:52.050735 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.050734 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15460h56m29.665686946s" Jun 14 22:47:52.085205 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.085179 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:52.085371 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.085344 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:47:52.093338 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.093293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerStarted","Data":"89d03f0cf8bbf56828c9816d18ec6f282bb32fc30784838cc0db8170165b9d72"} Jun 14 22:47:52.096889 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.096863 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wx6bp" event={"ID":"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf","Type":"ContainerStarted","Data":"f69270fdb98c670cc73fe75f3b2e7245522e23f255b09191dea5f25b0ad39ae5"} Jun 14 22:47:52.098242 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.098217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f244d" event={"ID":"9335656f-8c59-4678-b37e-b0c6401a867f","Type":"ContainerStarted","Data":"0fe6d36edf22389d5f26bc1c4fd5d4e3c41070dcfb185ac30181224e53d9824d"} Jun 14 22:47:52.100424 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.100394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pgfrr" event={"ID":"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a","Type":"ContainerStarted","Data":"3a8a7167da975367519272d98f9a24f34aa9fbcec850f670f7d6863ed89ba725"} Jun 14 22:47:52.101936 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.101913 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" event={"ID":"b47ea593-22a5-4604-a8ce-215d83678696","Type":"ContainerStarted","Data":"1cd07f562ce546c965c6ed7bf8fa9f8943847ef7b737b574b5e368d85bcd7629"} Jun 14 22:47:52.107710 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.107681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"fc9bb10506827d2410c7069de196f43860b6e59e12943c5aeba6ef480976d6d8"} Jun 14 22:47:52.109090 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.109067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzw9c" event={"ID":"6b06b7bd-b307-48e4-81d8-d90ad3d7491f","Type":"ContainerStarted","Data":"e28d10b9eb9a4646d281a02c9abe59c2a28261a90039cce27691006e23a0a97c"} Jun 14 22:47:52.112635 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.112565 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" event={"ID":"43d43933e113029bd040b626c0b9543c","Type":"ContainerStarted","Data":"8a2334cde2eba087a8a8df13d5adcd007e0ddbd00e5aa825a286ca190a5c2ddf"} Jun 14 22:47:52.116814 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.116349 2563 generic.go:356] "Generic (PLEG): container finished" podID="6574df0fbbcf2e9ad2074fbcad86a366" containerID="7ea9797e61de4b72fda6bf66db4484b62bde13a8cfbc223c7cea0d3e2f4affb2" exitCode=0 Jun 14 22:47:52.116814 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.116428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" event={"ID":"6574df0fbbcf2e9ad2074fbcad86a366","Type":"ContainerDied","Data":"7ea9797e61de4b72fda6bf66db4484b62bde13a8cfbc223c7cea0d3e2f4affb2"} Jun 14 22:47:52.120063 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.119908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" event={"ID":"d9544096-962a-4427-a374-55e65cdee292","Type":"ContainerStarted","Data":"921a8680e0f2499c4e172a4ff2973de6bb63df023611bcdc54c6a5275d4f103c"} Jun 14 22:47:52.123173 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.121074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6jf4" event={"ID":"22194b3e-c52c-4b11-ab07-e82ffee15eb8","Type":"ContainerStarted","Data":"8d716f7190d3ce8455bf07929553a040cc0b9406308d6b1968aef33af6dde0c2"} Jun 14 22:47:52.141970 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.141914 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" podStartSLOduration=2.141895422 podStartE2EDuration="2.141895422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:52.127755344 +0000 UTC m=+3.471145174" watchObservedRunningTime="2026-06-14 22:47:52.141895422 +0000 UTC m=+3.485285249" Jun 14 22:47:52.642359 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.642243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:52.642515 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.642444 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:52.642515 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.642509 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:54.642490125 +0000 UTC m=+5.985879946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:52.743561 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.743514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:52.743724 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.743697 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:52.743783 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.743776 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:54.743757624 +0000 UTC m=+6.087147448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:52.844687 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:52.844380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:52.844687 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.844539 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:52.844687 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.844560 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:52.844687 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.844572 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:52.844687 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:52.844630 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:54.844612871 +0000 UTC m=+6.188002698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:53.051760 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:53.051693 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 22:42:51 +0000 UTC" deadline="2028-03-11 04:23:27.727562538 +0000 UTC" Jun 14 22:47:53.051760 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:53.051758 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15245h35m34.675809029s" Jun 14 22:47:53.087331 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:53.087283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:53.087507 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:53.087463 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:47:53.087568 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:53.087515 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:53.087679 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:53.087636 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:47:53.140410 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:53.140372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" event={"ID":"6574df0fbbcf2e9ad2074fbcad86a366","Type":"ContainerStarted","Data":"63f3dfd3c28fd6c9d7d0a4317f4210a4c09187db5680a5995e2d909d8f894398"} Jun 14 22:47:53.155134 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:53.155075 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" podStartSLOduration=3.155059967 podStartE2EDuration="3.155059967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:47:53.154412029 +0000 UTC m=+4.497801856" watchObservedRunningTime="2026-06-14 22:47:53.155059967 +0000 UTC m=+4.498449792" Jun 14 22:47:54.085175 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:54.085146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:54.085651 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.085289 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:47:54.660031 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:54.659467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:54.660031 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.659622 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:54.660031 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.659690 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:58.659671886 +0000 UTC m=+10.003061692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:54.760857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:54.760325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:54.760857 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.760466 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:54.760857 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.760534 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:58.760516441 +0000 UTC m=+10.103906249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:54.861447 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:54.861408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:54.861618 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.861566 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:54.861618 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.861585 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:54.861618 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.861597 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:54.861784 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:54.861655 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:47:58.861637858 +0000 UTC m=+10.205027665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:55.085442 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:55.085412 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:55.085886 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:55.085543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:47:55.087950 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:55.087870 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:55.088072 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:55.087978 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:47:56.085381 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:56.085085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:56.085381 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:56.085204 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:47:57.084769 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:57.084734 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:57.084938 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:57.084872 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:47:57.084938 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:57.084887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:57.085062 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:57.084958 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:47:58.084823 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:58.084787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:58.085197 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.084935 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:47:58.696844 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:58.696257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:47:58.696844 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.696443 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:58.696844 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.696506 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:06.696487531 +0000 UTC m=+18.039877358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:47:58.796934 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:58.796896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:58.797116 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.797069 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:58.797171 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.797130 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:06.797112789 +0000 UTC m=+18.140502610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:47:58.897879 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:58.897838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:58.898079 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.898052 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:47:58.898154 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.898090 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:47:58.898154 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.898105 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:58.898255 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:58.898212 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:06.898148668 +0000 UTC m=+18.241538489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:47:59.085769 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:59.085146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:47:59.085769 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:59.085253 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:47:59.085769 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:47:59.085323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:47:59.085769 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:47:59.085394 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:00.085113 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:00.085076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:00.085270 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:00.085226 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:01.085138 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:01.085104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:01.085582 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:01.085105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:01.085582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:01.085380 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:01.085582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:01.085236 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:02.084697 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:02.084677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:02.084805 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:02.084787 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:03.087229 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:03.087202 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:03.087229 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:03.087217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:03.087752 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:03.087342 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:03.087752 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:03.087400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:04.085174 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:04.085145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:04.085367 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:04.085274 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:05.084324 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:05.084272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:05.084776 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:05.084347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:05.084776 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:05.084426 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:05.084776 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:05.084539 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:06.084767 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:06.084736 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:06.085230 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.084853 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:06.758564 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:06.758526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:06.758752 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.758674 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:06.758752 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.758746 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:22.75872466 +0000 UTC m=+34.102114487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:06.859632 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:06.859598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:06.859801 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.859783 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:06.859874 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.859862 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:22.859841287 +0000 UTC m=+34.203231109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:06.960348 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:06.960297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:06.960519 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.960496 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:06.960571 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.960529 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:06.960571 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.960542 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:06.960634 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:06.960606 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:22.960587862 +0000 UTC m=+34.303977675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:07.084968 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:07.084895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:07.085388 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:07.085007 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:07.085388 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:07.085062 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:07.085388 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:07.085117 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:08.084901 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:08.084867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:08.085082 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:08.085004 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:09.085981 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:09.085942 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:09.086473 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:09.086061 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:09.086473 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:09.086460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:09.086575 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:09.086555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:10.085020 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:10.084984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:10.085186 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:10.085112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:11.085217 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.085013 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:11.086054 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:11.085368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:11.086054 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.085146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:11.086054 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:11.085678 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:11.183499 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.183465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" event={"ID":"d9544096-962a-4427-a374-55e65cdee292","Type":"ContainerStarted","Data":"d2a94fd881bb5b7fe2bd451f1093f780528e5f8bb975c5793ca73f8446445fc3"} Jun 14 22:48:11.185018 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.184986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6jf4" event={"ID":"22194b3e-c52c-4b11-ab07-e82ffee15eb8","Type":"ContainerStarted","Data":"9fa54f81ce994ba700330a043fd2b51f220b82fafd8a0f2acff738d2279adc64"} Jun 14 22:48:11.186765 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.186740 2563 generic.go:356] "Generic (PLEG): container finished" podID="94011f2d-9bdb-4eda-a7cb-a38279ec0deb" containerID="e3e69cd21903ac1f575aad7b9b80bcd96a45ffe18b3b23e630dfe2489cfe86cb" exitCode=0 Jun 14 22:48:11.186876 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.186811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerDied","Data":"e3e69cd21903ac1f575aad7b9b80bcd96a45ffe18b3b23e630dfe2489cfe86cb"} Jun 14 22:48:11.188480 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.188438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wx6bp" event={"ID":"c6467c97-cfb8-4a9b-bac4-f61d0c73cacf","Type":"ContainerStarted","Data":"7bb3a8ee47d71f45159cbaf7fd7d519e3265f7b18584901b00e5d4063b5ea258"} Jun 14 22:48:11.189973 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.189950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f244d" event={"ID":"9335656f-8c59-4678-b37e-b0c6401a867f","Type":"ContainerStarted","Data":"257b65cb50bd6e99fd51bd04587d48cca919c8bab87396b81b51cb4f85f76439"} Jun 14 22:48:11.191728 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.191707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pgfrr" event={"ID":"e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a","Type":"ContainerStarted","Data":"daffb11dcf9721c5353aaa52d482f81041f2ae2e8c90ee43949173013ace351a"} Jun 14 22:48:11.193284 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.193260 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" event={"ID":"b47ea593-22a5-4604-a8ce-215d83678696","Type":"ContainerStarted","Data":"3c39ba0cfac2c1e506f6d717eb8379059ed738cedd5551a95e220eff32533ae2"} Jun 14 22:48:11.196225 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.196206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"80bd2d3a1c2fa09bd5798fe03a2b49d88bfd8b0a380a6ee90113318b104e5296"} Jun 14 22:48:11.196353 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.196276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"5c403cc5df81ece6cbda053401473d4f765821339b648703a7fa63b8dc48c621"} Jun 14 22:48:11.196353 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.196341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"79d7ec3b8235c32740fbbea37cec8d04ad5734590bdeec79af91579cecee2706"} Jun 14 22:48:11.196476 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.196388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"aa9617a0ea6d95fa37505ea50bf7ecf5f75cd5b8824d29a716e9fd9078eda799"} Jun 14 22:48:11.196476 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.196436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"a5097cc19fbdffef84086864cfc37ce96392532d6855f3be6dbd3ade1f97cfec"} Jun 14 22:48:11.196573 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.196486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"0a872ffd1292f30e1a8aa2c9c90cf214d355b5929a0ea93e03a03be4c4062c75"} Jun 14 22:48:11.200911 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.200877 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n6jf4" podStartSLOduration=3.595641764 podStartE2EDuration="22.200866376s" totalImagesPullingTime="18.605224612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:11.200367921 +0000 UTC m=+22.543757758" watchObservedRunningTime="2026-06-14 22:48:11.200866376 +0000 UTC m=+22.544256201" Jun 14 22:48:11.232769 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.232728 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f244d" podStartSLOduration=11.895780828 podStartE2EDuration="22.232715766s" totalImagesPullingTime="10.336934938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:11.232344561 +0000 UTC m=+22.575734390" watchObservedRunningTime="2026-06-14 22:48:11.232715766 +0000 UTC m=+22.576105591" Jun 14 22:48:11.245365 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.245323 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wx6bp" podStartSLOduration=3.6349871240000002 podStartE2EDuration="22.245291935s" totalImagesPullingTime="18.610304811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:11.245120958 +0000 UTC m=+22.588510784" watchObservedRunningTime="2026-06-14 22:48:11.245291935 +0000 UTC m=+22.588681761" Jun 14 22:48:11.260362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.260327 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ttcpk" podStartSLOduration=3.6508184740000003 podStartE2EDuration="22.260295909s" totalImagesPullingTime="18.609477435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:11.259849875 +0000 UTC m=+22.603239701" watchObservedRunningTime="2026-06-14 22:48:11.260295909 +0000 UTC m=+22.603685735" Jun 14 22:48:11.276073 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.276030 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pgfrr" podStartSLOduration=3.608479685 podStartE2EDuration="22.276012584s" totalImagesPullingTime="18.667532899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:11.275546705 +0000 UTC m=+22.618936531" watchObservedRunningTime="2026-06-14 22:48:11.276012584 +0000 UTC m=+22.619402409" Jun 14 22:48:11.898422 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:11.898380 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 22:48:12.084706 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.084535 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T22:48:11.898404825Z","UUID":"3ef4b73e-2b86-42a3-ac97-30dc7ee41ee8","Handler":null,"Name":"","Endpoint":""} Jun 14 22:48:12.084917 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.084708 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:12.084917 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:12.084826 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:12.087319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.087284 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 22:48:12.087705 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.087339 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 22:48:12.200475 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.200439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" event={"ID":"d9544096-962a-4427-a374-55e65cdee292","Type":"ContainerStarted","Data":"4c4b9f28f05aa5cb356fedd63557dc564a3a3f48356c26be6539f91eab815745"} Jun 14 22:48:12.202047 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.202017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzw9c" event={"ID":"6b06b7bd-b307-48e4-81d8-d90ad3d7491f","Type":"ContainerStarted","Data":"282a0ec9c82d6892c26426d47798d0964d2251a607e599176856dbf455026ee2"} Jun 14 22:48:12.215358 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:12.215294 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzw9c" podStartSLOduration=4.601649257 podStartE2EDuration="23.215274087s" totalImagesPullingTime="18.61362483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:12.215267055 +0000 UTC m=+23.558656881" watchObservedRunningTime="2026-06-14 22:48:12.215274087 +0000 UTC m=+23.558663909" Jun 14 22:48:13.084920 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.084894 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:13.085059 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:13.085025 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:13.085292 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.084900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:13.085453 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:13.085427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:13.208951 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.208773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"15b2bff3815f8670a0bd15ae2a29cba87d84135bb7f024cf7f9545dd63b41ec0"} Jun 14 22:48:13.211333 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.211287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" event={"ID":"d9544096-962a-4427-a374-55e65cdee292","Type":"ContainerStarted","Data":"e3140b2750be58e93eb4a0dbdc1c3a4483a7c443bc883e028398f268b5242610"} Jun 14 22:48:13.227113 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.227060 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmqjq" podStartSLOduration=3.485426783 podStartE2EDuration="24.227044142s" totalImagesPullingTime="20.741617359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:13.22602341 +0000 UTC m=+24.569413235" watchObservedRunningTime="2026-06-14 22:48:13.227044142 +0000 UTC m=+24.570433946" Jun 14 22:48:13.938622 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.938584 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f244d" Jun 14 22:48:13.939318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:13.939267 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f244d" Jun 14 22:48:14.084736 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:14.084702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:14.084916 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:14.084863 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:14.213903 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:14.213834 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f244d" Jun 14 22:48:14.214443 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:14.214424 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f244d" Jun 14 22:48:15.084695 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:15.084656 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:15.084893 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:15.084656 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:15.084893 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:15.084787 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:15.084893 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:15.084834 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:16.084847 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:16.084663 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:16.085537 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:16.084931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:16.218788 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:16.218755 2563 generic.go:356] "Generic (PLEG): container finished" podID="94011f2d-9bdb-4eda-a7cb-a38279ec0deb" containerID="0431a9b117354388d9d78cca24d84c9319322f756e0809f097edc5f31133abb5" exitCode=0 Jun 14 22:48:16.218966 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:16.218844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerDied","Data":"0431a9b117354388d9d78cca24d84c9319322f756e0809f097edc5f31133abb5"} Jun 14 22:48:16.222961 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:16.222929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" event={"ID":"5c794efc-df60-4a85-92fb-9ca2f9328997","Type":"ContainerStarted","Data":"05d0d4120e5abceb7d9dd09a26b6d152971731bc6897de56cd185b6dca2aedcd"} Jun 14 22:48:16.266695 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:16.266654 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" podStartSLOduration=8.599587596 podStartE2EDuration="27.26664313s" totalImagesPullingTime="18.667055534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:16.266564539 +0000 UTC m=+27.609954375" watchObservedRunningTime="2026-06-14 22:48:16.26664313 +0000 UTC m=+27.610032955" Jun 14 22:48:17.084933 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.084905 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:17.084933 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.084922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:17.085612 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:17.085066 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:17.085612 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:17.085177 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:17.225698 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.225671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:48:17.225870 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.225748 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:48:17.225870 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.225787 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:48:17.243379 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.243352 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:48:17.243577 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.243539 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:48:17.332993 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.332960 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m479d"] Jun 14 22:48:17.333146 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.333110 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:17.333260 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:17.333239 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:17.336054 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.335994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzztj"] Jun 14 22:48:17.336173 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.336076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:17.336173 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:17.336164 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:17.344467 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.344443 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztgxq"] Jun 14 22:48:17.344582 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:17.344555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:17.344681 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:17.344645 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:18.230059 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:18.229856 2563 generic.go:356] "Generic (PLEG): container finished" podID="94011f2d-9bdb-4eda-a7cb-a38279ec0deb" containerID="e0885d099e0057964f8b85b9d230e26a28af9e1a6c7a8ece3259461673e9893b" exitCode=0 Jun 14 22:48:18.230635 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:18.229945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerDied","Data":"e0885d099e0057964f8b85b9d230e26a28af9e1a6c7a8ece3259461673e9893b"} Jun 14 22:48:19.085382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:19.085344 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:19.085560 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:19.085443 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:19.085560 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:19.085462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:19.085671 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:19.085598 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:19.085772 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:19.085668 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:19.085772 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:19.085589 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:20.236507 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:20.236471 2563 generic.go:356] "Generic (PLEG): container finished" podID="94011f2d-9bdb-4eda-a7cb-a38279ec0deb" containerID="2093235c9c1e40401927f34f7636808f0265fd4aa51d9556b8d1255c1d0ae044" exitCode=0 Jun 14 22:48:20.237060 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:20.236516 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerDied","Data":"2093235c9c1e40401927f34f7636808f0265fd4aa51d9556b8d1255c1d0ae044"} Jun 14 22:48:21.084990 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:21.084948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:21.084990 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:21.084991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:21.085203 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:21.084948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:21.085203 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:21.085079 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:21.085203 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:21.085141 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:21.085433 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:21.085216 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:22.781543 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:22.781491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:22.782161 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.781648 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:22.782161 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.781724 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:54.781705153 +0000 UTC m=+66.125094971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:22.882800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:22.882768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:22.882966 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.882939 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:22.883025 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.883019 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret podName:e2285496-6eda-4c2c-8268-1c79a6c5b035 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:54.882997751 +0000 UTC m=+66.226387571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret") pod "global-pull-secret-syncer-fzztj" (UID: "e2285496-6eda-4c2c-8268-1c79a6c5b035") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:22.983491 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:22.983441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:22.983677 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.983626 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:22.983677 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.983651 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:22.983677 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.983662 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rgzsc for pod openshift-network-diagnostics/network-check-target-ztgxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:22.983841 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:22.983726 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc podName:008bd825-24e3-4bb6-9a3d-e0ad484a8882 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:54.983707513 +0000 UTC m=+66.327097340 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgzsc" (UniqueName: "kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc") pod "network-check-target-ztgxq" (UID: "008bd825-24e3-4bb6-9a3d-e0ad484a8882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:23.084717 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.084631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:23.084717 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.084677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:23.084717 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.084633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:23.085002 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:23.084778 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:48:23.085002 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:23.084835 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzztj" podUID="e2285496-6eda-4c2c-8268-1c79a6c5b035" Jun 14 22:48:23.085002 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:23.084904 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztgxq" podUID="008bd825-24e3-4bb6-9a3d-e0ad484a8882" Jun 14 22:48:23.937426 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.937397 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeReady" Jun 14 22:48:23.937922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.937555 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 22:48:23.979546 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.979517 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rfffn"] Jun 14 22:48:23.991770 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.991723 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8blzj"] Jun 14 22:48:23.992058 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.992025 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:23.994982 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.994831 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jjmh8\"" Jun 14 22:48:23.994982 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.994858 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 22:48:23.995169 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:23.994942 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 22:48:24.001502 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.001399 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rfffn"] Jun 14 22:48:24.001502 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.001445 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8blzj"] Jun 14 22:48:24.001684 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.001521 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.004173 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.004138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 22:48:24.004173 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.004154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 22:48:24.004359 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.004144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 22:48:24.004359 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.004144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dq9pf\"" Jun 14 22:48:24.091333 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.091290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbb2\" (UniqueName: \"kubernetes.io/projected/778614cd-14d0-472f-bc7e-66bd5135a807-kube-api-access-4mbb2\") pod \"ingress-canary-8blzj\" (UID: \"778614cd-14d0-472f-bc7e-66bd5135a807\") " pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.091483 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.091354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-config-volume\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.091483 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.091387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.091483 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.091401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-tmp-dir\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.091483 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.091473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lmll\" (UniqueName: \"kubernetes.io/projected/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-kube-api-access-9lmll\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.091633 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.091535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/778614cd-14d0-472f-bc7e-66bd5135a807-cert\") pod \"ingress-canary-8blzj\" (UID: \"778614cd-14d0-472f-bc7e-66bd5135a807\") " pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.192165 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbb2\" (UniqueName: \"kubernetes.io/projected/778614cd-14d0-472f-bc7e-66bd5135a807-kube-api-access-4mbb2\") pod \"ingress-canary-8blzj\" (UID: \"778614cd-14d0-472f-bc7e-66bd5135a807\") " pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.192165 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-config-volume\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.192425 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.192425 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-tmp-dir\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.192425 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:24.192338 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:24.192425 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:24.192397 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:24.692378645 +0000 UTC m=+36.035768464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:48:24.192609 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lmll\" (UniqueName: \"kubernetes.io/projected/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-kube-api-access-9lmll\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.192609 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/778614cd-14d0-472f-bc7e-66bd5135a807-cert\") pod \"ingress-canary-8blzj\" (UID: \"778614cd-14d0-472f-bc7e-66bd5135a807\") " pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.192686 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-tmp-dir\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.192717 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.192693 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-config-volume\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.196623 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.196602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/778614cd-14d0-472f-bc7e-66bd5135a807-cert\") pod \"ingress-canary-8blzj\" (UID: \"778614cd-14d0-472f-bc7e-66bd5135a807\") " pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.202261 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.202238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lmll\" (UniqueName: \"kubernetes.io/projected/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-kube-api-access-9lmll\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.202447 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.202431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbb2\" (UniqueName: \"kubernetes.io/projected/778614cd-14d0-472f-bc7e-66bd5135a807-kube-api-access-4mbb2\") pod \"ingress-canary-8blzj\" (UID: \"778614cd-14d0-472f-bc7e-66bd5135a807\") " pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.313365 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.313339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8blzj" Jun 14 22:48:24.696721 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.696479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:24.696721 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:24.696644 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:24.696845 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:24.696788 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:25.69676238 +0000 UTC m=+37.040152191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:48:24.715434 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:24.715410 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8blzj"] Jun 14 22:48:24.718556 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:48:24.718528 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778614cd_14d0_472f_bc7e_66bd5135a807.slice/crio-d627bc667303605e29598490cb10976cc8fb7049b5bece2a826770a60ce6503b WatchSource:0}: Error finding container d627bc667303605e29598490cb10976cc8fb7049b5bece2a826770a60ce6503b: Status 404 returned error can't find the container with id d627bc667303605e29598490cb10976cc8fb7049b5bece2a826770a60ce6503b Jun 14 22:48:25.084854 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.084773 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:25.085369 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.084790 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:25.085369 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.085076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:25.087914 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.087892 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 22:48:25.088042 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.087912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 22:48:25.088042 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.087912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 22:48:25.089189 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.089168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cnbs\"" Jun 14 22:48:25.089301 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.089204 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 22:48:25.089301 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.089265 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6g9m\"" Jun 14 22:48:25.251502 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.251470 2563 generic.go:356] "Generic (PLEG): container finished" podID="94011f2d-9bdb-4eda-a7cb-a38279ec0deb" containerID="a45f601afcca4c435525e1c2cbcc0e2fd44b7b56d209a9fb45b98e03f5f424d9" exitCode=0 Jun 14 22:48:25.251671 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.251559 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerDied","Data":"a45f601afcca4c435525e1c2cbcc0e2fd44b7b56d209a9fb45b98e03f5f424d9"} Jun 14 22:48:25.252879 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.252856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8blzj" event={"ID":"778614cd-14d0-472f-bc7e-66bd5135a807","Type":"ContainerStarted","Data":"d627bc667303605e29598490cb10976cc8fb7049b5bece2a826770a60ce6503b"} Jun 14 22:48:25.705404 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:25.705366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:25.705594 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:25.705551 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:25.705665 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:25.705622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:27.705603861 +0000 UTC m=+39.048993669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:48:26.259475 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:26.259439 2563 generic.go:356] "Generic (PLEG): container finished" podID="94011f2d-9bdb-4eda-a7cb-a38279ec0deb" containerID="c60885b7abdd2f33bf5322bae9d18e56138742c7ce764261f406ac4afee2b6b8" exitCode=0 Jun 14 22:48:26.259903 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:26.259490 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerDied","Data":"c60885b7abdd2f33bf5322bae9d18e56138742c7ce764261f406ac4afee2b6b8"} Jun 14 22:48:27.264808 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:27.264618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c29ds" event={"ID":"94011f2d-9bdb-4eda-a7cb-a38279ec0deb","Type":"ContainerStarted","Data":"b20841e35a6c844564361d41f65f9ad42b7bc572336f0a5ed0505cfd81ed785e"} Jun 14 22:48:27.266025 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:27.266001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8blzj" event={"ID":"778614cd-14d0-472f-bc7e-66bd5135a807","Type":"ContainerStarted","Data":"7c152003ac043b8d194a4cb054dd0bc44ed0b79bfaf2cf3c08c7d1da906a6e69"} Jun 14 22:48:27.286397 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:27.286350 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c29ds" podStartSLOduration=9.044167487 podStartE2EDuration="38.286335085s" totalImagesPullingTime="29.242167598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:27.285985427 +0000 UTC m=+38.629375254" watchObservedRunningTime="2026-06-14 22:48:27.286335085 +0000 UTC m=+38.629724912" Jun 14 22:48:27.299375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:27.299339 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8blzj" podStartSLOduration=2.674347148 podStartE2EDuration="4.299325891s" totalImagesPullingTime="1.624978743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:27.299236221 +0000 UTC m=+38.642626047" watchObservedRunningTime="2026-06-14 22:48:27.299325891 +0000 UTC m=+38.642716006" Jun 14 22:48:27.721963 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:27.721929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:27.722146 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:27.722091 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:27.722205 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:27.722165 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:31.722145635 +0000 UTC m=+43.065535443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:48:31.748294 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:31.748251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:31.748713 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:31.748402 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:31.748713 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:31.748465 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:39.748450568 +0000 UTC m=+51.091840372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:48:39.804404 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:39.804361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:39.804924 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:39.804499 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:39.804924 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:39.804556 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:55.804541637 +0000 UTC m=+67.147931441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:48:49.242016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:49.241990 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqn78" Jun 14 22:48:54.810022 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:54.809976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:48:54.812546 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:54.812526 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 22:48:54.820510 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:54.820495 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:48:54.820559 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:54.820550 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:49:58.820534565 +0000 UTC m=+130.163924368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : secret "metrics-daemon-secret" not found Jun 14 22:48:54.911370 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:54.911340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:54.913890 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:54.913873 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 22:48:54.925547 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:54.925520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2285496-6eda-4c2c-8268-1c79a6c5b035-original-pull-secret\") pod \"global-pull-secret-syncer-fzztj\" (UID: \"e2285496-6eda-4c2c-8268-1c79a6c5b035\") " pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:55.011660 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.011623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:55.014694 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.014678 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 22:48:55.024800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.024780 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 22:48:55.035071 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.035040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzsc\" (UniqueName: \"kubernetes.io/projected/008bd825-24e3-4bb6-9a3d-e0ad484a8882-kube-api-access-rgzsc\") pod \"network-check-target-ztgxq\" (UID: \"008bd825-24e3-4bb6-9a3d-e0ad484a8882\") " pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:55.100435 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.100368 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cnbs\"" Jun 14 22:48:55.108425 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.108406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:48:55.109587 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.109573 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzztj" Jun 14 22:48:55.236666 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.236634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzztj"] Jun 14 22:48:55.240425 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:48:55.240398 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2285496_6eda_4c2c_8268_1c79a6c5b035.slice/crio-15a4319c0543ac8b9841189fe314716ec7a292adfc3b5e5bc115965a85f09722 WatchSource:0}: Error finding container 15a4319c0543ac8b9841189fe314716ec7a292adfc3b5e5bc115965a85f09722: Status 404 returned error can't find the container with id 15a4319c0543ac8b9841189fe314716ec7a292adfc3b5e5bc115965a85f09722 Jun 14 22:48:55.254694 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.254670 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztgxq"] Jun 14 22:48:55.257252 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:48:55.257228 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008bd825_24e3_4bb6_9a3d_e0ad484a8882.slice/crio-0e68454d95d50cd4bc14003ef1151ff227a122802c7894d87341577e63954a7a WatchSource:0}: Error finding container 0e68454d95d50cd4bc14003ef1151ff227a122802c7894d87341577e63954a7a: Status 404 returned error can't find the container with id 0e68454d95d50cd4bc14003ef1151ff227a122802c7894d87341577e63954a7a Jun 14 22:48:55.331775 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.331740 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzztj" event={"ID":"e2285496-6eda-4c2c-8268-1c79a6c5b035","Type":"ContainerStarted","Data":"15a4319c0543ac8b9841189fe314716ec7a292adfc3b5e5bc115965a85f09722"} Jun 14 22:48:55.332755 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.332731 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztgxq" event={"ID":"008bd825-24e3-4bb6-9a3d-e0ad484a8882","Type":"ContainerStarted","Data":"0e68454d95d50cd4bc14003ef1151ff227a122802c7894d87341577e63954a7a"} Jun 14 22:48:55.816593 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:48:55.816554 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:48:55.817031 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:55.816729 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:55.817031 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:48:55.816811 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:49:27.816788176 +0000 UTC m=+99.160177989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:49:00.348833 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:00.348792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzztj" event={"ID":"e2285496-6eda-4c2c-8268-1c79a6c5b035","Type":"ContainerStarted","Data":"37ee162e9743277de8c4cbd1de34018f88c5970d6c7c252f3087bd89071805f5"} Jun 14 22:49:00.350154 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:00.350132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztgxq" event={"ID":"008bd825-24e3-4bb6-9a3d-e0ad484a8882","Type":"ContainerStarted","Data":"19680871a8028ce340697029f4d6ecf5828d86ce354f0578295565cd583f917b"} Jun 14 22:49:00.350289 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:00.350274 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:49:00.362550 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:00.362514 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fzztj" podStartSLOduration=66.903685759 podStartE2EDuration="1m11.362503064s" totalImagesPullingTime="4.458817305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:49:00.362129906 +0000 UTC m=+71.705519732" watchObservedRunningTime="2026-06-14 22:49:00.362503064 +0000 UTC m=+71.705892889" Jun 14 22:49:00.375183 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:00.375061 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ztgxq" podStartSLOduration=66.936188339 podStartE2EDuration="1m11.375047719s" totalImagesPullingTime="4.43885938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:49:00.374705352 +0000 UTC m=+71.718095175" watchObservedRunningTime="2026-06-14 22:49:00.375047719 +0000 UTC m=+71.718437546" Jun 14 22:49:27.837002 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:27.836952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:49:27.837411 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:49:27.837100 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:49:27.837411 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:49:27.837167 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:50:31.83715243 +0000 UTC m=+163.180542237 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:49:31.354377 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:31.354349 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ztgxq" Jun 14 22:49:58.849063 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:49:58.849014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:49:58.849566 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:49:58.849172 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:49:58.849566 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:49:58.849251 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:00.849235198 +0000 UTC m=+252.192625001 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : secret "metrics-daemon-secret" not found Jun 14 22:50:27.006067 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:50:27.006016 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rfffn" podUID="2bf8ac80-66fd-47e9-bb5d-b0bf72451e24" Jun 14 22:50:27.546373 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:50:27.546347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfffn" Jun 14 22:50:28.103973 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:50:28.103937 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:50:31.876355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:50:31.876295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:50:31.876767 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:50:31.876458 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:50:31.876767 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:50:31.876530 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls podName:2bf8ac80-66fd-47e9-bb5d-b0bf72451e24 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:33.876513918 +0000 UTC m=+285.219903722 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls") pod "dns-default-rfffn" (UID: "2bf8ac80-66fd-47e9-bb5d-b0bf72451e24") : secret "dns-default-metrics-tls" not found Jun 14 22:50:39.085433 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:50:39.085347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:52:00.862349 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:00.862289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:52:00.862916 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:00.862483 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:52:00.862916 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:00.862567 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs podName:61ff5caf-e213-4186-9860-81bd8ad721f9 nodeName:}" failed. No retries permitted until 2026-06-14 22:54:02.862545536 +0000 UTC m=+374.205935356 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs") pod "network-metrics-daemon-m479d" (UID: "61ff5caf-e213-4186-9860-81bd8ad721f9") : secret "metrics-daemon-secret" not found Jun 14 22:52:02.665394 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.665363 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp"] Jun 14 22:52:02.666979 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.666960 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk"] Jun 14 22:52:02.667109 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.667086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.669126 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.669106 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-545f7d44b4-rwbqd"] Jun 14 22:52:02.669247 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.669233 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:02.669608 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.669591 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.669972 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.669958 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 22:52:02.670026 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.669985 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 22:52:02.670026 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.670007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dw9xc\"" Jun 14 22:52:02.670263 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.670250 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.670689 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.670676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.671560 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.671541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 14 22:52:02.671651 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.671543 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mjx22\"" Jun 14 22:52:02.672108 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.672095 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.672170 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.672097 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.674280 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.674261 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 22:52:02.674526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.674499 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kv5xf\"" Jun 14 22:52:02.674526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.674521 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 22:52:02.674675 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.674553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 22:52:02.680343 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.680325 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 22:52:02.686097 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.686075 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp"] Jun 14 22:52:02.686892 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.686873 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk"] Jun 14 22:52:02.688591 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.688571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-545f7d44b4-rwbqd"] Jun 14 22:52:02.755506 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.755474 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs"] Jun 14 22:52:02.757223 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.757204 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" Jun 14 22:52:02.759843 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.759821 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.759944 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.759863 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.760010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.759991 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n26px\"" Jun 14 22:52:02.762288 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.762271 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b969bcd5d-t7599"] Jun 14 22:52:02.763898 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.763879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.766717 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.766702 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gk5bq\"" Jun 14 22:52:02.766797 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.766703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 22:52:02.767156 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.767140 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.767383 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.767370 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 22:52:02.767431 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.767421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 22:52:02.767500 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.767482 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 22:52:02.767556 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.767541 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.769129 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.769105 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs"] Jun 14 22:52:02.772962 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.772941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9j99\" (UniqueName: \"kubernetes.io/projected/ed46765b-f119-48c6-83ea-50a3239ab177-kube-api-access-b9j99\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:02.773058 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.772981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d489860f-6b00-4b4d-a260-90b00a318b06-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.773058 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-trusted-ca\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.773058 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbsq\" (UniqueName: \"kubernetes.io/projected/d489860f-6b00-4b4d-a260-90b00a318b06-kube-api-access-twbsq\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.773221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-image-registry-private-configuration\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.773221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-bound-sa-token\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.773221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.773221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-ca-trust-extracted\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.774104 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:02.774104 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-installation-pull-secrets\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.774104 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t745m\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-kube-api-access-t745m\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.774104 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d489860f-6b00-4b4d-a260-90b00a318b06-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.774104 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.773429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-certificates\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.779319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.779275 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b969bcd5d-t7599"] Jun 14 22:52:02.874658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-image-registry-private-configuration\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.874658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-bound-sa-token\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.874911 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.874911 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-ca-trust-extracted\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.874911 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.874799 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:52:02.874911 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.874911 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.874822 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545f7d44b4-rwbqd: secret "image-registry-tls" not found Jun 14 22:52:02.874911 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.874921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls podName:12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:03.374896777 +0000 UTC m=+254.718286595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls") pod "image-registry-545f7d44b4-rwbqd" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0") : secret "image-registry-tls" not found Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.874951 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-installation-pull-secrets\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.874998 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-ca-trust-extracted\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.874999 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls podName:ed46765b-f119-48c6-83ea-50a3239ab177 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:03.374982762 +0000 UTC m=+254.718372580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls") pod "cluster-samples-operator-9547488fd-qszwk" (UID: "ed46765b-f119-48c6-83ea-50a3239ab177") : secret "samples-operator-tls" not found Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t745m\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-kube-api-access-t745m\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d489860f-6b00-4b4d-a260-90b00a318b06-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qllz\" (UniqueName: \"kubernetes.io/projected/26d35e08-ad8e-4934-9855-4f0e8cc11aff-kube-api-access-8qllz\") pod \"volume-data-source-validator-bd4ccd799-r78qs\" (UID: \"26d35e08-ad8e-4934-9855-4f0e8cc11aff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" Jun 14 22:52:02.875198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-certificates\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9j99\" (UniqueName: \"kubernetes.io/projected/ed46765b-f119-48c6-83ea-50a3239ab177-kube-api-access-b9j99\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtxb\" (UniqueName: \"kubernetes.io/projected/e0602555-bc97-4956-ac98-e2e25de93b49-kube-api-access-qjtxb\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d489860f-6b00-4b4d-a260-90b00a318b06-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-default-certificate\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-trusted-ca\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twbsq\" (UniqueName: \"kubernetes.io/projected/d489860f-6b00-4b4d-a260-90b00a318b06-kube-api-access-twbsq\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-stats-auth\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.875662 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d489860f-6b00-4b4d-a260-90b00a318b06-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.876092 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.875672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-certificates\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.876427 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.876404 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-trusted-ca\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.877252 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.877222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-image-registry-private-configuration\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.877391 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.877370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d489860f-6b00-4b4d-a260-90b00a318b06-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.877391 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.877379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-installation-pull-secrets\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.885904 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.885883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-bound-sa-token\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.889326 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.889291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t745m\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-kube-api-access-t745m\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:02.889532 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.889514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9j99\" (UniqueName: \"kubernetes.io/projected/ed46765b-f119-48c6-83ea-50a3239ab177-kube-api-access-b9j99\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:02.889641 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.889621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbsq\" (UniqueName: \"kubernetes.io/projected/d489860f-6b00-4b4d-a260-90b00a318b06-kube-api-access-twbsq\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kmplp\" (UID: \"d489860f-6b00-4b4d-a260-90b00a318b06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.976095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-default-certificate\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.976095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-stats-auth\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.976395 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.976395 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qllz\" (UniqueName: \"kubernetes.io/projected/26d35e08-ad8e-4934-9855-4f0e8cc11aff-kube-api-access-8qllz\") pod \"volume-data-source-validator-bd4ccd799-r78qs\" (UID: \"26d35e08-ad8e-4934-9855-4f0e8cc11aff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" Jun 14 22:52:02.976395 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.976395 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtxb\" (UniqueName: \"kubernetes.io/projected/e0602555-bc97-4956-ac98-e2e25de93b49-kube-api-access-qjtxb\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.976395 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.976330 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 22:52:02.976628 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.976429 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:03.476402904 +0000 UTC m=+254.819792724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : configmap references non-existent config key: service-ca.crt Jun 14 22:52:02.976628 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:02.976457 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:03.476446009 +0000 UTC m=+254.819835817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : secret "router-metrics-certs-default" not found Jun 14 22:52:02.976769 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.976753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" Jun 14 22:52:02.978532 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.978505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-default-certificate\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.978632 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.978554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-stats-auth\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.984226 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.984202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtxb\" (UniqueName: \"kubernetes.io/projected/e0602555-bc97-4956-ac98-e2e25de93b49-kube-api-access-qjtxb\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:02.984477 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:02.984450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qllz\" (UniqueName: \"kubernetes.io/projected/26d35e08-ad8e-4934-9855-4f0e8cc11aff-kube-api-access-8qllz\") pod \"volume-data-source-validator-bd4ccd799-r78qs\" (UID: \"26d35e08-ad8e-4934-9855-4f0e8cc11aff\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" Jun 14 22:52:03.066613 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.066579 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" Jun 14 22:52:03.100897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.100873 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp"] Jun 14 22:52:03.103191 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:03.103164 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd489860f_6b00_4b4d_a260_90b00a318b06.slice/crio-e4e32811b5253bf2b9b8391a46a286392270d8e82c2f4780840dea2859579539 WatchSource:0}: Error finding container e4e32811b5253bf2b9b8391a46a286392270d8e82c2f4780840dea2859579539: Status 404 returned error can't find the container with id e4e32811b5253bf2b9b8391a46a286392270d8e82c2f4780840dea2859579539 Jun 14 22:52:03.187205 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.187174 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs"] Jun 14 22:52:03.189686 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:03.189663 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d35e08_ad8e_4934_9855_4f0e8cc11aff.slice/crio-dc39b5e62732ca5cbb994e3e03e4761dfd145d17d04ff608a37f5c1ab8a82084 WatchSource:0}: Error finding container dc39b5e62732ca5cbb994e3e03e4761dfd145d17d04ff608a37f5c1ab8a82084: Status 404 returned error can't find the container with id dc39b5e62732ca5cbb994e3e03e4761dfd145d17d04ff608a37f5c1ab8a82084 Jun 14 22:52:03.379355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.379249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:03.379355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.379322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:03.379582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.379405 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 22:52:03.379582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.379413 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:52:03.379582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.379431 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545f7d44b4-rwbqd: secret "image-registry-tls" not found Jun 14 22:52:03.379582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.379455 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls podName:ed46765b-f119-48c6-83ea-50a3239ab177 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:04.379437896 +0000 UTC m=+255.722827702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls") pod "cluster-samples-operator-9547488fd-qszwk" (UID: "ed46765b-f119-48c6-83ea-50a3239ab177") : secret "samples-operator-tls" not found Jun 14 22:52:03.379582 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.379481 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls podName:12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:04.379464975 +0000 UTC m=+255.722854793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls") pod "image-registry-545f7d44b4-rwbqd" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0") : secret "image-registry-tls" not found Jun 14 22:52:03.480221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.480187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:03.480408 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.480244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:03.480408 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.480365 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 22:52:03.480515 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.480447 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:04.480426821 +0000 UTC m=+255.823816648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : secret "router-metrics-certs-default" not found Jun 14 22:52:03.480515 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:03.480469 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:04.480458853 +0000 UTC m=+255.823848675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : configmap references non-existent config key: service-ca.crt Jun 14 22:52:03.759003 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.758928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" event={"ID":"26d35e08-ad8e-4934-9855-4f0e8cc11aff","Type":"ContainerStarted","Data":"dc39b5e62732ca5cbb994e3e03e4761dfd145d17d04ff608a37f5c1ab8a82084"} Jun 14 22:52:03.760431 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:03.760400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" event={"ID":"d489860f-6b00-4b4d-a260-90b00a318b06","Type":"ContainerStarted","Data":"e4e32811b5253bf2b9b8391a46a286392270d8e82c2f4780840dea2859579539"} Jun 14 22:52:04.388902 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:04.388828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:04.388902 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:04.388871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:04.389074 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.389011 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:52:04.389074 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.389030 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545f7d44b4-rwbqd: secret "image-registry-tls" not found Jun 14 22:52:04.389074 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.389044 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 22:52:04.389183 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.389087 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls podName:12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:06.389067294 +0000 UTC m=+257.732457115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls") pod "image-registry-545f7d44b4-rwbqd" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0") : secret "image-registry-tls" not found Jun 14 22:52:04.389183 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.389104 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls podName:ed46765b-f119-48c6-83ea-50a3239ab177 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:06.389095512 +0000 UTC m=+257.732485316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls") pod "cluster-samples-operator-9547488fd-qszwk" (UID: "ed46765b-f119-48c6-83ea-50a3239ab177") : secret "samples-operator-tls" not found Jun 14 22:52:04.489555 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:04.489523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:04.489735 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:04.489618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:04.489735 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.489713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:06.489691735 +0000 UTC m=+257.833081553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : configmap references non-existent config key: service-ca.crt Jun 14 22:52:04.489735 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.489718 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 22:52:04.489884 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:04.489764 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:06.489754948 +0000 UTC m=+257.833144764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : secret "router-metrics-certs-default" not found Jun 14 22:52:04.764665 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:04.764632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" event={"ID":"26d35e08-ad8e-4934-9855-4f0e8cc11aff","Type":"ContainerStarted","Data":"757ae13a6b783f0dbeb87e37a74c0a2c2fe7a7f8b0dd8b1cc02356654a635e9c"} Jun 14 22:52:04.778894 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:04.778845 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-r78qs" podStartSLOduration=1.954877937 podStartE2EDuration="2.778826005s" totalImagesPullingTime="823.948068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:04.778633013 +0000 UTC m=+256.122022839" watchObservedRunningTime="2026-06-14 22:52:04.778826005 +0000 UTC m=+256.122215828" Jun 14 22:52:05.768946 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:05.768910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" event={"ID":"d489860f-6b00-4b4d-a260-90b00a318b06","Type":"ContainerStarted","Data":"4c550a123a9dcd99973ae52c93bde4c80ca9bb1dfc34e61b5e6ebd4bc714b4ef"} Jun 14 22:52:05.784543 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:05.784492 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" podStartSLOduration=2.097558331 podStartE2EDuration="3.784475524s" totalImagesPullingTime="1.686917193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:05.783850105 +0000 UTC m=+257.127239932" watchObservedRunningTime="2026-06-14 22:52:05.784475524 +0000 UTC m=+257.127865349" Jun 14 22:52:06.404542 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:06.404506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:06.404724 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:06.404553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:06.404724 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.404652 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:52:06.404724 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.404675 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545f7d44b4-rwbqd: secret "image-registry-tls" not found Jun 14 22:52:06.404819 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.404727 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls podName:12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:10.404712171 +0000 UTC m=+261.748101975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls") pod "image-registry-545f7d44b4-rwbqd" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0") : secret "image-registry-tls" not found Jun 14 22:52:06.404819 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.404674 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 22:52:06.404819 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.404768 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls podName:ed46765b-f119-48c6-83ea-50a3239ab177 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:10.404761913 +0000 UTC m=+261.748151716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls") pod "cluster-samples-operator-9547488fd-qszwk" (UID: "ed46765b-f119-48c6-83ea-50a3239ab177") : secret "samples-operator-tls" not found Jun 14 22:52:06.505244 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:06.505209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:06.505441 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:06.505261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:06.505441 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.505378 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:10.50536402 +0000 UTC m=+261.848753824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : configmap references non-existent config key: service-ca.crt Jun 14 22:52:06.505441 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.505375 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 22:52:06.505441 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:06.505407 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:10.505401577 +0000 UTC m=+261.848791381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : secret "router-metrics-certs-default" not found Jun 14 22:52:07.958405 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.958327 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wg9qr"] Jun 14 22:52:07.961321 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.961284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:07.963975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.963953 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 22:52:07.965282 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.965259 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 22:52:07.965394 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.965267 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 22:52:07.965394 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.965359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 22:52:07.965467 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.965268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2789x\"" Jun 14 22:52:07.973527 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:07.973502 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wg9qr"] Jun 14 22:52:08.118713 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.118675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.118713 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.118711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll8n6\" (UniqueName: \"kubernetes.io/projected/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-api-access-ll8n6\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.118907 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.118810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8530328b-17b2-4cbf-b35e-26696b9fb770-crio-socket\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.118907 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.118870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.118907 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.118895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8530328b-17b2-4cbf-b35e-26696b9fb770-data-volume\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219569 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219569 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8530328b-17b2-4cbf-b35e-26696b9fb770-data-volume\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219569 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll8n6\" (UniqueName: \"kubernetes.io/projected/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-api-access-ll8n6\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.219620 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8530328b-17b2-4cbf-b35e-26696b9fb770-crio-socket\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.219687 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:08.719666418 +0000 UTC m=+260.063056225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8530328b-17b2-4cbf-b35e-26696b9fb770-crio-socket\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.219697 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:08.219835 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.219753 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:08.719737309 +0000 UTC m=+260.063127119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : configmap "kube-rbac-proxy" not found Jun 14 22:52:08.220063 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.219894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8530328b-17b2-4cbf-b35e-26696b9fb770-data-volume\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.228597 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.228568 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll8n6\" (UniqueName: \"kubernetes.io/projected/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-api-access-ll8n6\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.723084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.723035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.723262 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:08.723140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:08.723262 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.723155 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:08.723262 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.723221 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:09.723205945 +0000 UTC m=+261.066595748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : configmap "kube-rbac-proxy" not found Jun 14 22:52:08.723404 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.723288 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.723404 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:08.723362 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:09.723346849 +0000 UTC m=+261.066736654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:09.731142 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:09.731111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:09.731505 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:09.731171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:09.731505 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:09.731262 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:09.731505 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:09.731326 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:11.731294937 +0000 UTC m=+263.074684742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : configmap "kube-rbac-proxy" not found Jun 14 22:52:09.731505 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:09.731261 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:09.731505 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:09.731391 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:11.731376947 +0000 UTC m=+263.074766758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:10.436815 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:10.436782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:10.436975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:10.436873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:10.436975 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.436940 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 22:52:10.436975 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.436963 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545f7d44b4-rwbqd: secret "image-registry-tls" not found Jun 14 22:52:10.436975 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.436963 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 22:52:10.437160 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.437013 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls podName:ed46765b-f119-48c6-83ea-50a3239ab177 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:18.437000932 +0000 UTC m=+269.780390736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls") pod "cluster-samples-operator-9547488fd-qszwk" (UID: "ed46765b-f119-48c6-83ea-50a3239ab177") : secret "samples-operator-tls" not found Jun 14 22:52:10.437160 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.437027 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls podName:12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:18.4370196 +0000 UTC m=+269.780409404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls") pod "image-registry-545f7d44b4-rwbqd" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0") : secret "image-registry-tls" not found Jun 14 22:52:10.537401 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:10.537368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:10.537559 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:10.537433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:10.537559 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.537525 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 22:52:10.537559 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.537535 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:18.537517464 +0000 UTC m=+269.880907279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : configmap references non-existent config key: service-ca.crt Jun 14 22:52:10.537658 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:10.537560 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs podName:e0602555-bc97-4956-ac98-e2e25de93b49 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:18.537550285 +0000 UTC m=+269.880940089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs") pod "router-default-b969bcd5d-t7599" (UID: "e0602555-bc97-4956-ac98-e2e25de93b49") : secret "router-metrics-certs-default" not found Jun 14 22:52:10.943558 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:10.943534 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6jf4_22194b3e-c52c-4b11-ab07-e82ffee15eb8/dns-node-resolver/0.log" Jun 14 22:52:11.747851 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:11.747815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:11.748033 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:11.747927 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:11.748033 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:11.747987 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:15.747972492 +0000 UTC m=+267.091362297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : configmap "kube-rbac-proxy" not found Jun 14 22:52:11.748033 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:11.748005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:11.748155 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:11.748116 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:11.748155 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:11.748147 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:15.748139969 +0000 UTC m=+267.091529773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:11.944641 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:11.944612 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wx6bp_c6467c97-cfb8-4a9b-bac4-f61d0c73cacf/node-ca/0.log" Jun 14 22:52:12.343706 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:12.343674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8blzj_778614cd-14d0-472f-bc7e-66bd5135a807/serve-healthcheck-canary/0.log" Jun 14 22:52:13.345202 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:13.345166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-kmplp_d489860f-6b00-4b4d-a260-90b00a318b06/kube-storage-version-migrator-operator/0.log" Jun 14 22:52:15.780011 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:15.779964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:15.780409 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:15.780101 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:15.780409 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:15.780134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:15.780409 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:15.780167 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:23.780152166 +0000 UTC m=+275.123541971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : configmap "kube-rbac-proxy" not found Jun 14 22:52:15.780409 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:15.780216 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:15.780409 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:15.780257 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls podName:8530328b-17b2-4cbf-b35e-26696b9fb770 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:23.780246736 +0000 UTC m=+275.123636541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg9qr" (UID: "8530328b-17b2-4cbf-b35e-26696b9fb770") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:18.502386 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.502349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:18.502756 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.502416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:18.504809 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.504783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed46765b-f119-48c6-83ea-50a3239ab177-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-qszwk\" (UID: \"ed46765b-f119-48c6-83ea-50a3239ab177\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:18.504929 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.504862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"image-registry-545f7d44b4-rwbqd\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:18.583456 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.583415 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:18.588678 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.588659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" Jun 14 22:52:18.603578 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.603550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:18.603759 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.603634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:18.604429 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.604410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0602555-bc97-4956-ac98-e2e25de93b49-service-ca-bundle\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:18.606631 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.606604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0602555-bc97-4956-ac98-e2e25de93b49-metrics-certs\") pod \"router-default-b969bcd5d-t7599\" (UID: \"e0602555-bc97-4956-ac98-e2e25de93b49\") " pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:18.674230 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.673977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:18.718173 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.718139 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-545f7d44b4-rwbqd"] Jun 14 22:52:18.720299 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:18.720273 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12510c3c_7300_4ad1_ba1e_1fb2d51ea0c0.slice/crio-d5ba21913ccbb78a241839b446b00d17fb5d9581626803722bc5106a10b9c1a6 WatchSource:0}: Error finding container d5ba21913ccbb78a241839b446b00d17fb5d9581626803722bc5106a10b9c1a6: Status 404 returned error can't find the container with id d5ba21913ccbb78a241839b446b00d17fb5d9581626803722bc5106a10b9c1a6 Jun 14 22:52:18.733039 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.733013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk"] Jun 14 22:52:18.801530 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.801505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" event={"ID":"ed46765b-f119-48c6-83ea-50a3239ab177","Type":"ContainerStarted","Data":"8caf6d3dd9f09e3ce9f5a9331c6a19aab7554fe29aba9afbeefa4483d2bd411d"} Jun 14 22:52:18.802950 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.802923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" event={"ID":"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0","Type":"ContainerStarted","Data":"f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477"} Jun 14 22:52:18.803054 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.802971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" event={"ID":"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0","Type":"ContainerStarted","Data":"d5ba21913ccbb78a241839b446b00d17fb5d9581626803722bc5106a10b9c1a6"} Jun 14 22:52:18.803095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.803072 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:18.811620 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.811509 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b969bcd5d-t7599"] Jun 14 22:52:18.813906 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:18.813881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0602555_bc97_4956_ac98_e2e25de93b49.slice/crio-6eb835ca841d8556b04cad860db39189497ed1a7f7595686c02dbf91fc9d054d WatchSource:0}: Error finding container 6eb835ca841d8556b04cad860db39189497ed1a7f7595686c02dbf91fc9d054d: Status 404 returned error can't find the container with id 6eb835ca841d8556b04cad860db39189497ed1a7f7595686c02dbf91fc9d054d Jun 14 22:52:18.822932 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:18.822890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" podStartSLOduration=16.822876201 podStartE2EDuration="16.822876201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:18.822466174 +0000 UTC m=+270.165856002" watchObservedRunningTime="2026-06-14 22:52:18.822876201 +0000 UTC m=+270.166266027" Jun 14 22:52:19.807976 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:19.807928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b969bcd5d-t7599" event={"ID":"e0602555-bc97-4956-ac98-e2e25de93b49","Type":"ContainerStarted","Data":"664bd7e1c358d8c5b156d8742983cbb69506f535c3203cade9c05a50442e326a"} Jun 14 22:52:19.808458 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:19.808007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b969bcd5d-t7599" event={"ID":"e0602555-bc97-4956-ac98-e2e25de93b49","Type":"ContainerStarted","Data":"6eb835ca841d8556b04cad860db39189497ed1a7f7595686c02dbf91fc9d054d"} Jun 14 22:52:19.826777 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:19.826725 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b969bcd5d-t7599" podStartSLOduration=17.826709536 podStartE2EDuration="17.826709536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:19.825840024 +0000 UTC m=+271.169229862" watchObservedRunningTime="2026-06-14 22:52:19.826709536 +0000 UTC m=+271.170099339" Jun 14 22:52:20.674844 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.674753 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:20.677200 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.677181 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:20.812951 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.812912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" event={"ID":"ed46765b-f119-48c6-83ea-50a3239ab177","Type":"ContainerStarted","Data":"524f2b27695228cf35aebf7172fc95fda59eddc56d91e3ea49fdcf4ee474a7f9"} Jun 14 22:52:20.813383 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.813116 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:20.813383 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.813151 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" event={"ID":"ed46765b-f119-48c6-83ea-50a3239ab177","Type":"ContainerStarted","Data":"4e20bde876c6953eb7428f63a5fe228827a60b939894828447b811d90957b8a2"} Jun 14 22:52:20.814278 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.814258 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b969bcd5d-t7599" Jun 14 22:52:20.828733 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:20.828692 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-qszwk" podStartSLOduration=17.377655327 podStartE2EDuration="18.828677735s" totalImagesPullingTime="1.451022408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:20.827589413 +0000 UTC m=+272.170979238" watchObservedRunningTime="2026-06-14 22:52:20.828677735 +0000 UTC m=+272.172067560" Jun 14 22:52:23.844714 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:23.844673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:23.845220 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:23.844746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:23.845394 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:23.845373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8530328b-17b2-4cbf-b35e-26696b9fb770-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:23.846906 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:23.846885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8530328b-17b2-4cbf-b35e-26696b9fb770-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg9qr\" (UID: \"8530328b-17b2-4cbf-b35e-26696b9fb770\") " pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:23.869915 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:23.869888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wg9qr" Jun 14 22:52:23.995915 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:23.995882 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wg9qr"] Jun 14 22:52:23.998917 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:23.998892 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8530328b_17b2_4cbf_b35e_26696b9fb770.slice/crio-f33d1301457089028b15524b461f9abb91eb68469bdcb42f02a5853cf1189c17 WatchSource:0}: Error finding container f33d1301457089028b15524b461f9abb91eb68469bdcb42f02a5853cf1189c17: Status 404 returned error can't find the container with id f33d1301457089028b15524b461f9abb91eb68469bdcb42f02a5853cf1189c17 Jun 14 22:52:24.836068 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:24.836015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg9qr" event={"ID":"8530328b-17b2-4cbf-b35e-26696b9fb770","Type":"ContainerStarted","Data":"f33d1301457089028b15524b461f9abb91eb68469bdcb42f02a5853cf1189c17"} Jun 14 22:52:27.846945 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:27.846913 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg9qr" event={"ID":"8530328b-17b2-4cbf-b35e-26696b9fb770","Type":"ContainerStarted","Data":"74c9ee9748b3dd51efb79fa3cb781fd61cd46278b165c5e4d04e7150b6efaf52"} Jun 14 22:52:28.851712 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:28.851676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg9qr" event={"ID":"8530328b-17b2-4cbf-b35e-26696b9fb770","Type":"ContainerStarted","Data":"830cd2cfc0c1f50fd50c18296645d63b8f0c6633fa82fdab2e73980d33d6df1f"} Jun 14 22:52:29.856530 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:29.856492 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg9qr" event={"ID":"8530328b-17b2-4cbf-b35e-26696b9fb770","Type":"ContainerStarted","Data":"694ac05bd7599e786740c8a6d1ca7d4fb4b490dc0ee2431f0ed5d7bd765bfc85"} Jun 14 22:52:29.874800 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:29.874749 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wg9qr" podStartSLOduration=17.213699361 podStartE2EDuration="22.874732799s" totalImagesPullingTime="5.661033438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:52:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:29.874003395 +0000 UTC m=+281.217393224" watchObservedRunningTime="2026-06-14 22:52:29.874732799 +0000 UTC m=+281.218122635" Jun 14 22:52:30.073008 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.072963 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-545f7d44b4-rwbqd"] Jun 14 22:52:30.074353 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.074322 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4"] Jun 14 22:52:30.077590 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.077568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:30.080027 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.079893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 22:52:30.080027 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.079907 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tbs57\"" Jun 14 22:52:30.085813 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.085788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4"] Jun 14 22:52:30.097011 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.096884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-hx6j4\" (UID: \"8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:30.097882 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.097859 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8494547889-b66h8"] Jun 14 22:52:30.100818 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.100801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.115267 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.115242 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8494547889-b66h8"] Jun 14 22:52:30.197334 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54798eaf-0768-4926-ab0f-858325410e70-registry-certificates\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54798eaf-0768-4926-ab0f-858325410e70-ca-trust-extracted\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-bound-sa-token\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj6mq\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-kube-api-access-xj6mq\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-hx6j4\" (UID: \"8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:30.197720 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-registry-tls\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197720 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54798eaf-0768-4926-ab0f-858325410e70-trusted-ca\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197720 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54798eaf-0768-4926-ab0f-858325410e70-image-registry-private-configuration\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.197720 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.197603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54798eaf-0768-4926-ab0f-858325410e70-installation-pull-secrets\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.200133 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.200081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-hx6j4\" (UID: \"8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:30.298204 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-bound-sa-token\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj6mq\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-kube-api-access-xj6mq\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-registry-tls\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54798eaf-0768-4926-ab0f-858325410e70-trusted-ca\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54798eaf-0768-4926-ab0f-858325410e70-image-registry-private-configuration\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54798eaf-0768-4926-ab0f-858325410e70-installation-pull-secrets\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54798eaf-0768-4926-ab0f-858325410e70-registry-certificates\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298712 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54798eaf-0768-4926-ab0f-858325410e70-ca-trust-extracted\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.298917 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.298893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54798eaf-0768-4926-ab0f-858325410e70-ca-trust-extracted\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.299290 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.299253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54798eaf-0768-4926-ab0f-858325410e70-registry-certificates\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.299485 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.299464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54798eaf-0768-4926-ab0f-858325410e70-trusted-ca\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.300921 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.300902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54798eaf-0768-4926-ab0f-858325410e70-image-registry-private-configuration\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.300971 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.300899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54798eaf-0768-4926-ab0f-858325410e70-installation-pull-secrets\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.301010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.300986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-registry-tls\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.306127 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.306105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-bound-sa-token\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.306691 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.306660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj6mq\" (UniqueName: \"kubernetes.io/projected/54798eaf-0768-4926-ab0f-858325410e70-kube-api-access-xj6mq\") pod \"image-registry-8494547889-b66h8\" (UID: \"54798eaf-0768-4926-ab0f-858325410e70\") " pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.387752 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.387657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:30.408743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.408707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.521642 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.521610 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4"] Jun 14 22:52:30.524158 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:30.524125 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9b6aff_29fd_4172_8d23_fc4ef0bc5ddd.slice/crio-0f960cb4615cdb1cd9c374e004ad8d61112bd0d008ae5abd0f481b31909a6146 WatchSource:0}: Error finding container 0f960cb4615cdb1cd9c374e004ad8d61112bd0d008ae5abd0f481b31909a6146: Status 404 returned error can't find the container with id 0f960cb4615cdb1cd9c374e004ad8d61112bd0d008ae5abd0f481b31909a6146 Jun 14 22:52:30.547025 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:30.546977 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rfffn" podUID="2bf8ac80-66fd-47e9-bb5d-b0bf72451e24" Jun 14 22:52:30.548593 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.548572 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8494547889-b66h8"] Jun 14 22:52:30.550723 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:30.550699 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54798eaf_0768_4926_ab0f_858325410e70.slice/crio-501abf7126f2d3a5ce3f516b8aa39798da4f53235c3e8b4d108eb751457cf0d2 WatchSource:0}: Error finding container 501abf7126f2d3a5ce3f516b8aa39798da4f53235c3e8b4d108eb751457cf0d2: Status 404 returned error can't find the container with id 501abf7126f2d3a5ce3f516b8aa39798da4f53235c3e8b4d108eb751457cf0d2 Jun 14 22:52:30.861816 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.861781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8494547889-b66h8" event={"ID":"54798eaf-0768-4926-ab0f-858325410e70","Type":"ContainerStarted","Data":"c3cd491371ead06aa8153cf291b70a42a4fc4ee156f4f0b353b0a5a3ccb561d2"} Jun 14 22:52:30.862248 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.861835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8494547889-b66h8" event={"ID":"54798eaf-0768-4926-ab0f-858325410e70","Type":"ContainerStarted","Data":"501abf7126f2d3a5ce3f516b8aa39798da4f53235c3e8b4d108eb751457cf0d2"} Jun 14 22:52:30.862248 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.861898 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:30.863083 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.863061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" event={"ID":"8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd","Type":"ContainerStarted","Data":"0f960cb4615cdb1cd9c374e004ad8d61112bd0d008ae5abd0f481b31909a6146"} Jun 14 22:52:30.863193 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.863100 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfffn" Jun 14 22:52:30.880857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:30.880806 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8494547889-b66h8" podStartSLOduration=0.880788572 podStartE2EDuration="880.788572ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:30.879047329 +0000 UTC m=+282.222437154" watchObservedRunningTime="2026-06-14 22:52:30.880788572 +0000 UTC m=+282.224178376" Jun 14 22:52:31.868271 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:31.868235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" event={"ID":"8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd","Type":"ContainerStarted","Data":"cead9b8aa0ebd8f396a1915d2f139e3d17fc087071da227a2a9cd0fb234a189c"} Jun 14 22:52:31.883763 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:31.883713 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" podStartSLOduration=0.772398091 podStartE2EDuration="1.883697358s" totalImagesPullingTime="1.111299267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:31.883191486 +0000 UTC m=+283.226581312" watchObservedRunningTime="2026-06-14 22:52:31.883697358 +0000 UTC m=+283.227087201" Jun 14 22:52:32.871804 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:32.871774 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:32.876286 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:32.876261 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-hx6j4" Jun 14 22:52:33.928993 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:33.928949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:52:33.931157 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:33.931133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bf8ac80-66fd-47e9-bb5d-b0bf72451e24-metrics-tls\") pod \"dns-default-rfffn\" (UID: \"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24\") " pod="openshift-dns/dns-default-rfffn" Jun 14 22:52:34.166816 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:34.166780 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jjmh8\"" Jun 14 22:52:34.174734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:34.174707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rfffn" Jun 14 22:52:34.303713 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:34.303683 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rfffn"] Jun 14 22:52:34.307834 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:34.307808 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf8ac80_66fd_47e9_bb5d_b0bf72451e24.slice/crio-ad0075b97f5707b9f9a20e0279dfadf10f9091c942367c12b061f9df31554c2c WatchSource:0}: Error finding container ad0075b97f5707b9f9a20e0279dfadf10f9091c942367c12b061f9df31554c2c: Status 404 returned error can't find the container with id ad0075b97f5707b9f9a20e0279dfadf10f9091c942367c12b061f9df31554c2c Jun 14 22:52:34.880583 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:34.880547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfffn" event={"ID":"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24","Type":"ContainerStarted","Data":"ad0075b97f5707b9f9a20e0279dfadf10f9091c942367c12b061f9df31554c2c"} Jun 14 22:52:35.885213 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:35.885177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfffn" event={"ID":"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24","Type":"ContainerStarted","Data":"ffe37767dc25e53b51bcb1445af3ae0d0fd5dcb7b77d25fbed16eec3e554a103"} Jun 14 22:52:35.885678 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:35.885617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rfffn" event={"ID":"2bf8ac80-66fd-47e9-bb5d-b0bf72451e24","Type":"ContainerStarted","Data":"55c9f72bc96fe1b17cffb7926e0f16cea2db62706f2fc68b3f9a441b0a51c801"} Jun 14 22:52:35.885743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:35.885683 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rfffn" Jun 14 22:52:35.902439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:35.902389 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rfffn" podStartSLOduration=251.509367547 podStartE2EDuration="4m12.902373542s" totalImagesPullingTime="1.393005995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:35.900797626 +0000 UTC m=+287.244187452" watchObservedRunningTime="2026-06-14 22:52:35.902373542 +0000 UTC m=+287.245763378" Jun 14 22:52:38.417049 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.417013 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj"] Jun 14 22:52:38.419985 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.419962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.422538 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.422517 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 14 22:52:38.423616 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.423594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 22:52:38.423727 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.423598 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 22:52:38.423727 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.423670 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6cwq6\"" Jun 14 22:52:38.423727 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.423693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 14 22:52:38.423727 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.423716 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 22:52:38.426987 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.426963 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9sfk2"] Jun 14 22:52:38.429734 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.429719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.432491 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.432475 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 22:52:38.432875 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.432854 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 22:52:38.432977 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.432856 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8p9k\"" Jun 14 22:52:38.432977 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.432944 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj"] Jun 14 22:52:38.433209 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.433191 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 22:52:38.461240 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9g4s\" (UniqueName: \"kubernetes.io/projected/eb6477b6-e537-4721-a375-ce3fab59fe2d-kube-api-access-p9g4s\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.461398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msn4t\" (UniqueName: \"kubernetes.io/projected/38e3c61b-94de-4e6e-a61f-f89ca00a6218-kube-api-access-msn4t\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.461398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461523 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-wtmp\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461523 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.461523 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e3c61b-94de-4e6e-a61f-f89ca00a6218-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.461523 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb6477b6-e537-4721-a375-ce3fab59fe2d-metrics-client-ca\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461638 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461638 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-sys\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461638 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-textfile\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461638 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-tls\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.461754 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.461645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-root\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.562580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.562757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e3c61b-94de-4e6e-a61f-f89ca00a6218-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.562757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb6477b6-e537-4721-a375-ce3fab59fe2d-metrics-client-ca\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.562757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.562757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-sys\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.562757 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-textfile\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-tls\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-root\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-sys\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-root\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:38.562913 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.562956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9g4s\" (UniqueName: \"kubernetes.io/projected/eb6477b6-e537-4721-a375-ce3fab59fe2d-kube-api-access-p9g4s\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563016 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:38.562978 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-tls podName:38e3c61b-94de-4e6e-a61f-f89ca00a6218 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:39.062956948 +0000 UTC m=+290.406346769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-2pvdj" (UID: "38e3c61b-94de-4e6e-a61f-f89ca00a6218") : secret "openshift-state-metrics-tls" not found Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-textfile\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msn4t\" (UniqueName: \"kubernetes.io/projected/38e3c61b-94de-4e6e-a61f-f89ca00a6218-kube-api-access-msn4t\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563107 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-wtmp\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb6477b6-e537-4721-a375-ce3fab59fe2d-metrics-client-ca\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563375 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-wtmp\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563747 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.563747 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.563739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e3c61b-94de-4e6e-a61f-f89ca00a6218-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.565214 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.565182 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.565371 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.565296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.565433 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.565374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb6477b6-e537-4721-a375-ce3fab59fe2d-node-exporter-tls\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.572907 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.572880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9g4s\" (UniqueName: \"kubernetes.io/projected/eb6477b6-e537-4721-a375-ce3fab59fe2d-kube-api-access-p9g4s\") pod \"node-exporter-9sfk2\" (UID: \"eb6477b6-e537-4721-a375-ce3fab59fe2d\") " pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.573258 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.573239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msn4t\" (UniqueName: \"kubernetes.io/projected/38e3c61b-94de-4e6e-a61f-f89ca00a6218-kube-api-access-msn4t\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:38.738670 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.738632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9sfk2" Jun 14 22:52:38.750181 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:38.750150 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6477b6_e537_4721_a375_ce3fab59fe2d.slice/crio-30cc23dee2820e19b1a837e62d8b5a0d6d5aeffa6fe53e5caef3a1c079d04cac WatchSource:0}: Error finding container 30cc23dee2820e19b1a837e62d8b5a0d6d5aeffa6fe53e5caef3a1c079d04cac: Status 404 returned error can't find the container with id 30cc23dee2820e19b1a837e62d8b5a0d6d5aeffa6fe53e5caef3a1c079d04cac Jun 14 22:52:38.895613 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:38.895582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sfk2" event={"ID":"eb6477b6-e537-4721-a375-ce3fab59fe2d","Type":"ContainerStarted","Data":"30cc23dee2820e19b1a837e62d8b5a0d6d5aeffa6fe53e5caef3a1c079d04cac"} Jun 14 22:52:39.066454 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.066361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:39.068670 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.068649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e3c61b-94de-4e6e-a61f-f89ca00a6218-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2pvdj\" (UID: \"38e3c61b-94de-4e6e-a61f-f89ca00a6218\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:39.329700 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.329625 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" Jun 14 22:52:39.485398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.485361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj"] Jun 14 22:52:39.673238 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:39.673170 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e3c61b_94de_4e6e_a61f_f89ca00a6218.slice/crio-af4cbac02be12a18b7eb785add1b75ce725a983f845c55d8aae59d78e8d72996 WatchSource:0}: Error finding container af4cbac02be12a18b7eb785add1b75ce725a983f845c55d8aae59d78e8d72996: Status 404 returned error can't find the container with id af4cbac02be12a18b7eb785add1b75ce725a983f845c55d8aae59d78e8d72996 Jun 14 22:52:39.900015 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.899979 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb6477b6-e537-4721-a375-ce3fab59fe2d" containerID="9bbac7aa1ff2b4c43dbd331b9135916fd95afa01af6fd73d067703bbe6a60443" exitCode=0 Jun 14 22:52:39.900197 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.900074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sfk2" event={"ID":"eb6477b6-e537-4721-a375-ce3fab59fe2d","Type":"ContainerDied","Data":"9bbac7aa1ff2b4c43dbd331b9135916fd95afa01af6fd73d067703bbe6a60443"} Jun 14 22:52:39.901885 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.901864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" event={"ID":"38e3c61b-94de-4e6e-a61f-f89ca00a6218","Type":"ContainerStarted","Data":"097af1acea13ff6b387b0103684ed3d5afdfe48cb242d7f333f94292f4f7c9c2"} Jun 14 22:52:39.901960 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.901910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" event={"ID":"38e3c61b-94de-4e6e-a61f-f89ca00a6218","Type":"ContainerStarted","Data":"1f97bf5bf18c83bc676d7fd41d15fcaa31e1d05d876b823f8099c9a57ad8c271"} Jun 14 22:52:39.901960 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:39.901933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" event={"ID":"38e3c61b-94de-4e6e-a61f-f89ca00a6218","Type":"ContainerStarted","Data":"af4cbac02be12a18b7eb785add1b75ce725a983f845c55d8aae59d78e8d72996"} Jun 14 22:52:40.077933 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:40.077904 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:40.908076 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:40.907978 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" event={"ID":"38e3c61b-94de-4e6e-a61f-f89ca00a6218","Type":"ContainerStarted","Data":"cd88313017cd99045ac9d2eb9f52f58b4ab1e3078db88b08ea1607cf249b5635"} Jun 14 22:52:40.909913 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:40.909890 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sfk2" event={"ID":"eb6477b6-e537-4721-a375-ce3fab59fe2d","Type":"ContainerStarted","Data":"9fe6bffe3844cb05bbb5aa4be05434edfb7006294deb2c9122cd544391606876"} Jun 14 22:52:40.910015 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:40.909933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sfk2" event={"ID":"eb6477b6-e537-4721-a375-ce3fab59fe2d","Type":"ContainerStarted","Data":"e4f31dc580f0e7e23e406fa2b3e89fc285df919dbb44e0ad48ae6826ee0967ae"} Jun 14 22:52:40.924797 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:40.924750 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2pvdj" podStartSLOduration=1.9996379260000001 podStartE2EDuration="2.924733917s" totalImagesPullingTime="925.095991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:40.923930971 +0000 UTC m=+292.267320818" watchObservedRunningTime="2026-06-14 22:52:40.924733917 +0000 UTC m=+292.268123743" Jun 14 22:52:40.943533 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:40.943483 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9sfk2" podStartSLOduration=1.895577726 podStartE2EDuration="2.943465505s" totalImagesPullingTime="980.442057ms" totalInitContainerRuntime="67.445722ms" isStatefulPod=true podCreationTimestamp="2026-06-14 22:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:40.942140402 +0000 UTC m=+292.285530234" watchObservedRunningTime="2026-06-14 22:52:40.943465505 +0000 UTC m=+292.286855331" Jun 14 22:52:42.085876 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:42.085832 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-m479d" podUID="61ff5caf-e213-4186-9860-81bd8ad721f9" Jun 14 22:52:42.731087 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.731053 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-779546945c-qvbsc"] Jun 14 22:52:42.734132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.734118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.736953 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.736931 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 14 22:52:42.737065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.736935 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 14 22:52:42.738116 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.738100 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6di8uges55asv\"" Jun 14 22:52:42.738195 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.738116 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 22:52:42.738362 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.738349 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 14 22:52:42.738416 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.738367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sjwgq\"" Jun 14 22:52:42.744283 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.744261 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-779546945c-qvbsc"] Jun 14 22:52:42.796642 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/825e414f-2f30-4d34-a255-33a8de6ff3b2-metrics-server-audit-profiles\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.796642 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825e414f-2f30-4d34-a255-33a8de6ff3b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.796877 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/825e414f-2f30-4d34-a255-33a8de6ff3b2-audit-log\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.796877 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-secret-metrics-server-tls\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.796877 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-client-ca-bundle\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.796877 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796763 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-secret-metrics-server-client-certs\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.796877 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.796839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbj52\" (UniqueName: \"kubernetes.io/projected/825e414f-2f30-4d34-a255-33a8de6ff3b2-kube-api-access-dbj52\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897708 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/825e414f-2f30-4d34-a255-33a8de6ff3b2-metrics-server-audit-profiles\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897708 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825e414f-2f30-4d34-a255-33a8de6ff3b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/825e414f-2f30-4d34-a255-33a8de6ff3b2-audit-log\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-secret-metrics-server-tls\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-client-ca-bundle\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-secret-metrics-server-client-certs\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.897975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.897880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj52\" (UniqueName: \"kubernetes.io/projected/825e414f-2f30-4d34-a255-33a8de6ff3b2-kube-api-access-dbj52\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.898707 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.898630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/825e414f-2f30-4d34-a255-33a8de6ff3b2-audit-log\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.899157 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.899131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/825e414f-2f30-4d34-a255-33a8de6ff3b2-metrics-server-audit-profiles\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.899300 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.899145 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825e414f-2f30-4d34-a255-33a8de6ff3b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.901226 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.901199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-secret-metrics-server-tls\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.902495 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.902465 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-client-ca-bundle\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.904975 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.904955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/825e414f-2f30-4d34-a255-33a8de6ff3b2-secret-metrics-server-client-certs\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:42.906482 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:42.906463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbj52\" (UniqueName: \"kubernetes.io/projected/825e414f-2f30-4d34-a255-33a8de6ff3b2-kube-api-access-dbj52\") pod \"metrics-server-779546945c-qvbsc\" (UID: \"825e414f-2f30-4d34-a255-33a8de6ff3b2\") " pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:43.042796 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.042699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:52:43.179848 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.179822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-779546945c-qvbsc"] Jun 14 22:52:43.182062 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:43.182038 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825e414f_2f30_4d34_a255_33a8de6ff3b2.slice/crio-e31675c62d501722920e21101063699e18308f25eb473edbddaeb7682aaf6a8f WatchSource:0}: Error finding container e31675c62d501722920e21101063699e18308f25eb473edbddaeb7682aaf6a8f: Status 404 returned error can't find the container with id e31675c62d501722920e21101063699e18308f25eb473edbddaeb7682aaf6a8f Jun 14 22:52:43.622439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.622404 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7648c89989-mtf54"] Jun 14 22:52:43.626901 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.626872 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.629605 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.629552 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 22:52:43.629605 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.629572 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 22:52:43.629605 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.629554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 22:52:43.629605 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.629595 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v7zg2\"" Jun 14 22:52:43.629922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.629599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 22:52:43.629922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.629842 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 22:52:43.635072 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.634939 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 22:52:43.637582 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.637511 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7648c89989-mtf54"] Jun 14 22:52:43.705987 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.705945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-serving-certs-ca-bundle\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706160 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.705997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-metrics-client-ca\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706160 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.706074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclh6\" (UniqueName: \"kubernetes.io/projected/0617e8ba-8eb8-46b4-931f-b941d102f8f7-kube-api-access-vclh6\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706160 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.706137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-federate-client-tls\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706300 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.706201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706300 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.706250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-secret-telemeter-client\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706300 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.706277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-telemeter-client-tls\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.706442 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.706370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807178 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807393 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-secret-telemeter-client\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807393 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-telemeter-client-tls\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807393 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807393 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-serving-certs-ca-bundle\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807613 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-metrics-client-ca\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807613 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vclh6\" (UniqueName: \"kubernetes.io/projected/0617e8ba-8eb8-46b4-931f-b941d102f8f7-kube-api-access-vclh6\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.807613 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.807606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-federate-client-tls\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.808161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.808103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-serving-certs-ca-bundle\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.808267 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.808225 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.808461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.808430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0617e8ba-8eb8-46b4-931f-b941d102f8f7-metrics-client-ca\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.810344 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.810321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.810767 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.810742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-telemeter-client-tls\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.810926 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.810907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-federate-client-tls\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.810926 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.810920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0617e8ba-8eb8-46b4-931f-b941d102f8f7-secret-telemeter-client\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.815873 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.815845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclh6\" (UniqueName: \"kubernetes.io/projected/0617e8ba-8eb8-46b4-931f-b941d102f8f7-kube-api-access-vclh6\") pod \"telemeter-client-7648c89989-mtf54\" (UID: \"0617e8ba-8eb8-46b4-931f-b941d102f8f7\") " pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:43.923695 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.923607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" event={"ID":"825e414f-2f30-4d34-a255-33a8de6ff3b2","Type":"ContainerStarted","Data":"e31675c62d501722920e21101063699e18308f25eb473edbddaeb7682aaf6a8f"} Jun 14 22:52:43.939078 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:43.939046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" Jun 14 22:52:44.095501 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.095467 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7648c89989-mtf54"] Jun 14 22:52:44.414981 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:44.414953 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0617e8ba_8eb8_46b4_931f_b941d102f8f7.slice/crio-1f8b8ff25a1d1d0da10917d587f1e4c1a3c5ecdde12864e3c0b8a28f3538a56c WatchSource:0}: Error finding container 1f8b8ff25a1d1d0da10917d587f1e4c1a3c5ecdde12864e3c0b8a28f3538a56c: Status 404 returned error can't find the container with id 1f8b8ff25a1d1d0da10917d587f1e4c1a3c5ecdde12864e3c0b8a28f3538a56c Jun 14 22:52:44.622150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.622092 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:52:44.625965 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.625945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.629555 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.629531 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 22:52:44.629731 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.629716 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 22:52:44.629795 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.629759 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 22:52:44.630095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.629938 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 22:52:44.630095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.629950 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 22:52:44.630095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.629979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 22:52:44.630095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630019 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 22:52:44.630395 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630379 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 22:52:44.630453 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630434 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 22:52:44.630507 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630493 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lvt2l\"" Jun 14 22:52:44.630700 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630685 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 22:52:44.630781 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630758 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 22:52:44.630982 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.630967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 22:52:44.631222 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.631207 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 22:52:44.631503 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.631488 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3eitla0dcr9hf\"" Jun 14 22:52:44.633380 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.633360 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 22:52:44.643751 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.643723 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:52:44.714596 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-config-out\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-web-config\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-config\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.714785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh622\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-kube-api-access-fh622\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714889 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.714985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.715003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.715032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715075 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.715046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715367 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.715076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715367 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.715097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.715367 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.715117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.815883 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.815850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.815891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.815909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.815942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.815965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.815984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-config-out\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-web-config\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-config\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh622\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-kube-api-access-fh622\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.816990 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.816910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.818091 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.817241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.818091 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.817867 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.819033 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.819008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.819140 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.819070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.821176 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.821136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.821268 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.821185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.821902 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.821349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.821902 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.821636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.821902 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.821796 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.821902 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.821847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-config\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.822149 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.822130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.822398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.822342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.822398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.822349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.823385 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.822745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-web-config\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.823385 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.823166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.823385 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.823368 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-config-out\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.825120 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.823664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.827179 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.827156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.828939 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.828918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh622\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-kube-api-access-fh622\") pod \"prometheus-k8s-0\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.929438 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.929398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" event={"ID":"0617e8ba-8eb8-46b4-931f-b941d102f8f7","Type":"ContainerStarted","Data":"1f8b8ff25a1d1d0da10917d587f1e4c1a3c5ecdde12864e3c0b8a28f3538a56c"} Jun 14 22:52:44.931007 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.930982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" event={"ID":"825e414f-2f30-4d34-a255-33a8de6ff3b2","Type":"ContainerStarted","Data":"95706ead1bff2427b09f6207fc57cebec28adde86e017efc8cf5eb730fcd7479"} Jun 14 22:52:44.936508 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.936475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:44.948301 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:44.948241 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" podStartSLOduration=1.670982645 podStartE2EDuration="2.948217206s" totalImagesPullingTime="1.277234561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:44.946142544 +0000 UTC m=+296.289532369" watchObservedRunningTime="2026-06-14 22:52:44.948217206 +0000 UTC m=+296.291607033" Jun 14 22:52:45.091279 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:45.091247 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:52:45.097259 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:52:45.097215 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79eb3e58_cf30_4771_b46a_75d7e14a5010.slice/crio-25972fb89a97fd506f0c3b8995d956a6fbbdb0f3b01973bee7f427b3b7e42a5d WatchSource:0}: Error finding container 25972fb89a97fd506f0c3b8995d956a6fbbdb0f3b01973bee7f427b3b7e42a5d: Status 404 returned error can't find the container with id 25972fb89a97fd506f0c3b8995d956a6fbbdb0f3b01973bee7f427b3b7e42a5d Jun 14 22:52:45.890945 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:45.890911 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rfffn" Jun 14 22:52:45.937181 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:45.937139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"25972fb89a97fd506f0c3b8995d956a6fbbdb0f3b01973bee7f427b3b7e42a5d"} Jun 14 22:52:46.943226 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:46.943189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" event={"ID":"0617e8ba-8eb8-46b4-931f-b941d102f8f7","Type":"ContainerStarted","Data":"79040e6752feae76fe05c787ca1152c2fd9b19c36e571a5dc907202b0dcbc8a2"} Jun 14 22:52:46.943693 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:46.943259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" event={"ID":"0617e8ba-8eb8-46b4-931f-b941d102f8f7","Type":"ContainerStarted","Data":"9fb1a44bc3b98576ca30b91e7e436abd2bebc39c3ca74989cb0081f7a7a17aa1"} Jun 14 22:52:46.943693 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:46.943278 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" event={"ID":"0617e8ba-8eb8-46b4-931f-b941d102f8f7","Type":"ContainerStarted","Data":"bcc76ef72d898e49e1e519e16e76a341ba7d3abd613671841a16e623a9ece719"} Jun 14 22:52:46.944640 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:46.944618 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" exitCode=0 Jun 14 22:52:46.944733 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:46.944695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} Jun 14 22:52:46.967189 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:46.967133 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7648c89989-mtf54" podStartSLOduration=1.941036386 podStartE2EDuration="3.967119438s" totalImagesPullingTime="2.026083052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:46.965868556 +0000 UTC m=+298.309258381" watchObservedRunningTime="2026-06-14 22:52:46.967119438 +0000 UTC m=+298.310509263" Jun 14 22:52:49.918376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:49.918346 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 22:52:50.071291 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:50.071267 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:52:50.965388 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:50.965345 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} Jun 14 22:52:50.965865 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:50.965424 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} Jun 14 22:52:51.873292 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:51.873266 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8494547889-b66h8" Jun 14 22:52:51.972463 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:51.972383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} Jun 14 22:52:51.972463 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:51.972448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} Jun 14 22:52:51.972832 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:51.972472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} Jun 14 22:52:52.978814 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:52.978785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerStarted","Data":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} Jun 14 22:52:53.009665 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:53.009601 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.007189251 podStartE2EDuration="9.009582565s" totalImagesPullingTime="5.979740788s" totalInitContainerRuntime="22.652526ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:53.006866318 +0000 UTC m=+304.350256144" watchObservedRunningTime="2026-06-14 22:52:53.009582565 +0000 UTC m=+304.352972390" Jun 14 22:52:54.936914 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:54.936874 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:52:55.094269 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.094223 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" podUID="12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" containerName="registry" containerID="cri-o://f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477" gracePeriod=30 Jun 14 22:52:55.336196 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.336174 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:55.418191 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418160 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-installation-pull-secrets\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418201 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-image-registry-private-configuration\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418222 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t745m\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-kube-api-access-t745m\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418251 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418281 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-trusted-ca\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418317 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-bound-sa-token\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418376 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418347 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-ca-trust-extracted\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418731 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418435 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-certificates\") pod \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\" (UID: \"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0\") " Jun 14 22:52:55.418785 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.418759 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:52:55.419089 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.419048 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:52:55.420799 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.420760 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:52:55.420799 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.420761 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:52:55.420964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.420884 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:52:55.420964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.420887 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-kube-api-access-t745m" (OuterVolumeSpecName: "kube-api-access-t745m") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "kube-api-access-t745m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:52:55.420964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.420911 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:52:55.426990 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.426964 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" (UID: "12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519338 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-certificates\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519373 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-installation-pull-secrets\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519384 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-image-registry-private-configuration\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519394 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t745m\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-kube-api-access-t745m\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519403 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-registry-tls\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519411 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-trusted-ca\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519419 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-bound-sa-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.519421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.519427 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0-ca-trust-extracted\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:52:55.992301 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.992262 2563 generic.go:356] "Generic (PLEG): container finished" podID="12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" containerID="f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477" exitCode=0 Jun 14 22:52:55.992764 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.992333 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" Jun 14 22:52:55.992764 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.992335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" event={"ID":"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0","Type":"ContainerDied","Data":"f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477"} Jun 14 22:52:55.992764 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.992398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545f7d44b4-rwbqd" event={"ID":"12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0","Type":"ContainerDied","Data":"d5ba21913ccbb78a241839b446b00d17fb5d9581626803722bc5106a10b9c1a6"} Jun 14 22:52:55.992764 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:55.992427 2563 scope.go:117] "RemoveContainer" containerID="f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477" Jun 14 22:52:56.001058 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:56.001037 2563 scope.go:117] "RemoveContainer" containerID="f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477" Jun 14 22:52:56.001346 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:52:56.001323 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477\": container with ID starting with f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477 not found: ID does not exist" containerID="f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477" Jun 14 22:52:56.001406 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:56.001354 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477"} err="failed to get container status \"f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477\": rpc error: code = NotFound desc = could not find container \"f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477\": container with ID starting with f96fc44673b516ea03822614966bc6fb2cfa3dcf72dee88c5d392283c5b8f477 not found: ID does not exist" Jun 14 22:52:56.013447 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:56.013420 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-545f7d44b4-rwbqd"] Jun 14 22:52:56.017628 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:56.017603 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-545f7d44b4-rwbqd"] Jun 14 22:52:56.085219 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:56.085186 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:52:57.089465 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:52:57.089432 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" path="/var/lib/kubelet/pods/12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0/volumes" Jun 14 22:53:03.043729 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:03.043692 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:53:03.044162 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:03.043781 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:53:23.049120 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:23.049088 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:53:23.053041 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:23.053020 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-779546945c-qvbsc" Jun 14 22:53:36.140126 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:36.140090 2563 generic.go:356] "Generic (PLEG): container finished" podID="d489860f-6b00-4b4d-a260-90b00a318b06" containerID="4c550a123a9dcd99973ae52c93bde4c80ca9bb1dfc34e61b5e6ebd4bc714b4ef" exitCode=0 Jun 14 22:53:36.140671 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:36.140141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" event={"ID":"d489860f-6b00-4b4d-a260-90b00a318b06","Type":"ContainerDied","Data":"4c550a123a9dcd99973ae52c93bde4c80ca9bb1dfc34e61b5e6ebd4bc714b4ef"} Jun 14 22:53:36.140671 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:36.140579 2563 scope.go:117] "RemoveContainer" containerID="4c550a123a9dcd99973ae52c93bde4c80ca9bb1dfc34e61b5e6ebd4bc714b4ef" Jun 14 22:53:37.151107 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:37.151066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kmplp" event={"ID":"d489860f-6b00-4b4d-a260-90b00a318b06","Type":"ContainerStarted","Data":"64a9ecc448955d1371545ab23e0e186bd2ec2240ab5486c5f457256f311c0f65"} Jun 14 22:53:44.937546 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:44.937439 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:53:44.952851 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:44.952828 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:53:45.195051 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:53:45.194980 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:02.911167 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.911104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:54:02.913528 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.913506 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61ff5caf-e213-4186-9860-81bd8ad721f9-metrics-certs\") pod \"network-metrics-daemon-m479d\" (UID: \"61ff5caf-e213-4186-9860-81bd8ad721f9\") " pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:54:02.955875 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.955840 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:54:02.956189 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.956151 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="prometheus" containerID="cri-o://3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" gracePeriod=600 Jun 14 22:54:02.956355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.956195 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="thanos-sidecar" containerID="cri-o://1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" gracePeriod=600 Jun 14 22:54:02.956355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.956205 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-thanos" containerID="cri-o://346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" gracePeriod=600 Jun 14 22:54:02.956355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.956223 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="config-reloader" containerID="cri-o://e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" gracePeriod=600 Jun 14 22:54:02.956355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.956230 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-web" containerID="cri-o://22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" gracePeriod=600 Jun 14 22:54:02.956355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.956170 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy" containerID="cri-o://05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" gracePeriod=600 Jun 14 22:54:02.988439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.988413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6g9m\"" Jun 14 22:54:02.997000 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:02.996969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m479d" Jun 14 22:54:03.137471 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.137435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m479d"] Jun 14 22:54:03.140456 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:54:03.140420 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ff5caf_e213_4186_9860_81bd8ad721f9.slice/crio-0256219932e3fb80857f5066ed534c9d26c81625ccea79152646287e7cfc92fb WatchSource:0}: Error finding container 0256219932e3fb80857f5066ed534c9d26c81625ccea79152646287e7cfc92fb: Status 404 returned error can't find the container with id 0256219932e3fb80857f5066ed534c9d26c81625ccea79152646287e7cfc92fb Jun 14 22:54:03.212198 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.212172 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248895 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" exitCode=0 Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248925 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" exitCode=0 Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248934 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" exitCode=0 Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248943 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" exitCode=0 Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248951 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" exitCode=0 Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248959 2563 generic.go:356] "Generic (PLEG): container finished" podID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" exitCode=0 Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.248993 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.249084 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.249051 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} Jun 14 22:54:03.252997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.250097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} Jun 14 22:54:03.252997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.250384 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} Jun 14 22:54:03.252997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.250175 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.252997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.250906 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} Jun 14 22:54:03.253841 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.253813 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} Jun 14 22:54:03.253996 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.253887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} Jun 14 22:54:03.253996 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.253944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79eb3e58-cf30-4771-b46a-75d7e14a5010","Type":"ContainerDied","Data":"25972fb89a97fd506f0c3b8995d956a6fbbdb0f3b01973bee7f427b3b7e42a5d"} Jun 14 22:54:03.260275 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.260245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m479d" event={"ID":"61ff5caf-e213-4186-9860-81bd8ad721f9","Type":"ContainerStarted","Data":"0256219932e3fb80857f5066ed534c9d26c81625ccea79152646287e7cfc92fb"} Jun 14 22:54:03.266764 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.266736 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.274899 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.274874 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.282461 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.282437 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.289476 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.289452 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.296653 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.296628 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.304363 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.304342 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.311163 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.311141 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.311516 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.311494 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.311565 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.311528 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} err="failed to get container status \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" Jun 14 22:54:03.311565 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.311547 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.311795 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.311778 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.311843 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.311803 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} err="failed to get container status \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" Jun 14 22:54:03.311843 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.311820 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.312054 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.312030 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.312160 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312063 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} err="failed to get container status \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" Jun 14 22:54:03.312160 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312093 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.312370 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.312354 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.312420 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312374 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} err="failed to get container status \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" Jun 14 22:54:03.312420 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312387 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.312616 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.312600 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.312673 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312623 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} err="failed to get container status \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" Jun 14 22:54:03.312673 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312642 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.312876 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.312859 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.312914 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312880 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} err="failed to get container status \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" Jun 14 22:54:03.312914 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.312893 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.313097 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:54:03.313083 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.313161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313103 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} err="failed to get container status \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" Jun 14 22:54:03.313161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313121 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.313435 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313406 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} err="failed to get container status \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" Jun 14 22:54:03.313435 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313435 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.313628 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313613 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} err="failed to get container status \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" Jun 14 22:54:03.313676 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313628 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.313834 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313815 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} err="failed to get container status \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" Jun 14 22:54:03.313884 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.313835 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.314046 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314029 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} err="failed to get container status \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" Jun 14 22:54:03.314095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314046 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.314221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314205 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-serving-certs-ca-bundle\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314298 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314239 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-config-out\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314298 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314266 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-config\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314415 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314294 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314415 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314334 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} err="failed to get container status \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" Jun 14 22:54:03.314415 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314349 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.314415 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314348 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314422 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-tls\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314456 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-tls-assets\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314479 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-1\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314507 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-web-config\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314547 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-kube-rbac-proxy\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314578 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh622\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-kube-api-access-fh622\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314649 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-kubelet-serving-ca-bundle\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314657 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314678 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-metrics-client-ca\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314720 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-db\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314768 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-metrics-client-certs\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314798 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-grpc-tls\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314847 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-0\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.314908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-2\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314918 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-trusted-ca-bundle\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314920 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} err="failed to get container status \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314946 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.314944 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-thanos-prometheus-http-client-file\") pod \"79eb3e58-cf30-4771-b46a-75d7e14a5010\" (UID: \"79eb3e58-cf30-4771-b46a-75d7e14a5010\") " Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315202 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315200 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} err="failed to get container status \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" Jun 14 22:54:03.315318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315222 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.315677 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315540 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} err="failed to get container status \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" Jun 14 22:54:03.315677 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315561 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315917 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} err="failed to get container status \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315940 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.315979 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.316199 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} err="failed to get container status \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.316220 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.316518 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} err="failed to get container status \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" Jun 14 22:54:03.316743 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.316539 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.317142 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.316755 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} err="failed to get container status \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" Jun 14 22:54:03.317142 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.316774 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.317250 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317149 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.317300 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317271 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.317381 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317354 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-config-out" (OuterVolumeSpecName: "config-out") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:54:03.317811 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317433 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} err="failed to get container status \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" Jun 14 22:54:03.317811 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317462 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.317964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317812 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.317964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317822 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:54:03.317964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317842 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.317964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317878 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.317964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317903 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} err="failed to get container status \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" Jun 14 22:54:03.317964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.317963 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.318324 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.318249 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.318644 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.318618 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:03.319058 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.318779 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.319191 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319041 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.319191 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319086 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-config" (OuterVolumeSpecName: "config") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.319191 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.318644 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} err="failed to get container status \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" Jun 14 22:54:03.319191 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319188 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.319606 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319497 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} err="failed to get container status \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" Jun 14 22:54:03.319606 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319524 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.319606 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319547 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.319807 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319754 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} err="failed to get container status \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" Jun 14 22:54:03.319807 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319771 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.319981 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.319954 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.320238 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320057 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} err="failed to get container status \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" Jun 14 22:54:03.320238 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320091 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.320428 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320297 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:54:03.320428 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320362 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} err="failed to get container status \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" Jun 14 22:54:03.320428 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320385 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.320646 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320625 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-kube-api-access-fh622" (OuterVolumeSpecName: "kube-api-access-fh622") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "kube-api-access-fh622". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:54:03.320690 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320653 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} err="failed to get container status \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" Jun 14 22:54:03.320690 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320668 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.320895 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320872 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} err="failed to get container status \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" Jun 14 22:54:03.320943 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.320898 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.321041 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321020 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.321193 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321177 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} err="failed to get container status \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" Jun 14 22:54:03.321239 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321194 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.321403 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321386 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} err="failed to get container status \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" Jun 14 22:54:03.321403 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321402 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.321614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321598 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} err="failed to get container status \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" Jun 14 22:54:03.321658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321614 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.321802 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321786 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} err="failed to get container status \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" Jun 14 22:54:03.321854 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.321802 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.322048 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322022 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} err="failed to get container status \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" Jun 14 22:54:03.322101 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322051 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.322277 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322263 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} err="failed to get container status \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" Jun 14 22:54:03.322354 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322277 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.322536 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322519 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} err="failed to get container status \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" Jun 14 22:54:03.322580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322537 2563 scope.go:117] "RemoveContainer" containerID="346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83" Jun 14 22:54:03.322768 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322747 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83"} err="failed to get container status \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": rpc error: code = NotFound desc = could not find container \"346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83\": container with ID starting with 346981cea5271957f4c4998ae995a2edf29b09da5231a51077a2a5e086224b83 not found: ID does not exist" Jun 14 22:54:03.322856 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322768 2563 scope.go:117] "RemoveContainer" containerID="05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358" Jun 14 22:54:03.322971 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322954 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358"} err="failed to get container status \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": rpc error: code = NotFound desc = could not find container \"05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358\": container with ID starting with 05abd0dc46da41cb11ddab011549557b65ec1b5fac80c432f701f473e4412358 not found: ID does not exist" Jun 14 22:54:03.323016 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.322971 2563 scope.go:117] "RemoveContainer" containerID="22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963" Jun 14 22:54:03.323182 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323155 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963"} err="failed to get container status \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": rpc error: code = NotFound desc = could not find container \"22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963\": container with ID starting with 22a7955c48ac79b5015f98eb095981baf9f5629bbcb11532863ffe5a07ae3963 not found: ID does not exist" Jun 14 22:54:03.323182 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323177 2563 scope.go:117] "RemoveContainer" containerID="1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1" Jun 14 22:54:03.323511 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323490 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1"} err="failed to get container status \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": rpc error: code = NotFound desc = could not find container \"1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1\": container with ID starting with 1bdcab72aded5ffa24846d0434210d36afff7654a5c4b3ca5cc32242466531f1 not found: ID does not exist" Jun 14 22:54:03.323511 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323511 2563 scope.go:117] "RemoveContainer" containerID="e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272" Jun 14 22:54:03.323745 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323728 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272"} err="failed to get container status \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": rpc error: code = NotFound desc = could not find container \"e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272\": container with ID starting with e0f2e9bcaa9ce49c912874ec89db79e6789257fe91ceb4af67aaa727756de272 not found: ID does not exist" Jun 14 22:54:03.323813 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323748 2563 scope.go:117] "RemoveContainer" containerID="3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706" Jun 14 22:54:03.324011 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.323995 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706"} err="failed to get container status \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": rpc error: code = NotFound desc = could not find container \"3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706\": container with ID starting with 3962dd17943ecbfa2e90e5254fd7b3b38fe651b6462e34d59ad737652a940706 not found: ID does not exist" Jun 14 22:54:03.324059 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.324012 2563 scope.go:117] "RemoveContainer" containerID="21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126" Jun 14 22:54:03.324243 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.324226 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126"} err="failed to get container status \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": rpc error: code = NotFound desc = could not find container \"21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126\": container with ID starting with 21ee5f0c898e32bbdab7dbf2421e2fbc2bae4724ebefeed0306e58eb4bf25126 not found: ID does not exist" Jun 14 22:54:03.331150 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.331125 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-web-config" (OuterVolumeSpecName: "web-config") pod "79eb3e58-cf30-4771-b46a-75d7e14a5010" (UID: "79eb3e58-cf30-4771-b46a-75d7e14a5010"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:03.415841 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415809 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.415841 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415837 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.415841 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415847 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415857 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415867 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-config-out\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415878 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-config\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415887 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415897 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415906 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415914 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-tls-assets\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415923 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415930 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-web-config\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415940 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-kube-rbac-proxy\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415961 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh622\" (UniqueName: \"kubernetes.io/projected/79eb3e58-cf30-4771-b46a-75d7e14a5010-kube-api-access-fh622\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415970 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415980 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eb3e58-cf30-4771-b46a-75d7e14a5010-configmap-metrics-client-ca\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415990 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79eb3e58-cf30-4771-b46a-75d7e14a5010-prometheus-k8s-db\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.415997 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-metrics-client-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.416065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.416005 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79eb3e58-cf30-4771-b46a-75d7e14a5010-secret-grpc-tls\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:54:03.576434 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.576401 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:54:03.580643 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.580613 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:54:03.602964 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.602940 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:54:03.603221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603203 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-thanos" Jun 14 22:54:03.603221 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603221 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-thanos" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603237 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="init-config-reloader" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603245 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="init-config-reloader" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603254 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-web" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603263 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-web" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603273 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="thanos-sidecar" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603282 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="thanos-sidecar" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603295 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="prometheus" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603316 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="prometheus" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603325 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603330 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603341 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" containerName="registry" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603350 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" containerName="registry" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603362 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="config-reloader" Jun 14 22:54:03.603382 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603369 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="config-reloader" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603426 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="thanos-sidecar" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603433 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603439 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-web" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603445 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="12510c3c-7300-4ad1-ba1e-1fb2d51ea0c0" containerName="registry" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603450 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="kube-rbac-proxy-thanos" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603457 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="prometheus" Jun 14 22:54:03.603922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.603462 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" containerName="config-reloader" Jun 14 22:54:03.607005 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.606986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.609606 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.609578 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 22:54:03.610022 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.609806 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lvt2l\"" Jun 14 22:54:03.610022 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.609812 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 22:54:03.610022 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.609815 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 22:54:03.610231 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610035 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 22:54:03.610231 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610189 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3eitla0dcr9hf\"" Jun 14 22:54:03.610231 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610211 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 22:54:03.610434 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610270 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 22:54:03.610580 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610564 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 22:54:03.610787 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610769 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 22:54:03.610881 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610797 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 22:54:03.610922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.610775 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 22:54:03.611043 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.611028 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 22:54:03.611099 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.611040 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 22:54:03.612999 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.612974 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 22:54:03.615674 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.615653 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 22:54:03.624542 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.624522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:54:03.717720 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.717908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/630efe13-5eba-484c-b336-0337d8521151-config-out\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.717908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.717908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.717908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-config\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.717908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.717908 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9r6\" (UniqueName: \"kubernetes.io/projected/630efe13-5eba-484c-b336-0337d8521151-kube-api-access-jz9r6\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.717975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/630efe13-5eba-484c-b336-0337d8521151-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718132 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-web-config\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718452 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718452 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718452 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718452 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.718452 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.718221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819640 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819640 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9r6\" (UniqueName: \"kubernetes.io/projected/630efe13-5eba-484c-b336-0337d8521151-kube-api-access-jz9r6\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819640 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819890 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819890 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/630efe13-5eba-484c-b336-0337d8521151-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819890 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.819890 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.819753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820614 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820725 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-web-config\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820725 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820725 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.820897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/630efe13-5eba-484c-b336-0337d8521151-config-out\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.821161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.821161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.821161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.821161 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.820996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-config\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.821398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.821264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.821398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.821279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.823821 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.822842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.823821 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.822987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.823821 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.823272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/630efe13-5eba-484c-b336-0337d8521151-config-out\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.823821 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.823525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.824066 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.823869 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.824066 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.823921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.825241 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.824491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.825241 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.824519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/630efe13-5eba-484c-b336-0337d8521151-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.825241 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.824990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.825241 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.825110 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.826010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.825555 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-web-config\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.826010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.825558 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.826010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.825800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.826010 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.825970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.826325 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.826130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/630efe13-5eba-484c-b336-0337d8521151-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.826493 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.826471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-config\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.827347 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.827325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/630efe13-5eba-484c-b336-0337d8521151-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.827878 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.827859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9r6\" (UniqueName: \"kubernetes.io/projected/630efe13-5eba-484c-b336-0337d8521151-kube-api-access-jz9r6\") pod \"prometheus-k8s-0\" (UID: \"630efe13-5eba-484c-b336-0337d8521151\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:03.919357 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:03.919325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:54:04.091248 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.091108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 22:54:04.093587 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:54:04.093562 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630efe13_5eba_484c_b336_0337d8521151.slice/crio-235a9fafef036911133a7b49ee5dba2b46d4bedf673c8ff6b836fe3a34b469e1 WatchSource:0}: Error finding container 235a9fafef036911133a7b49ee5dba2b46d4bedf673c8ff6b836fe3a34b469e1: Status 404 returned error can't find the container with id 235a9fafef036911133a7b49ee5dba2b46d4bedf673c8ff6b836fe3a34b469e1 Jun 14 22:54:04.266591 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.266557 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m479d" event={"ID":"61ff5caf-e213-4186-9860-81bd8ad721f9","Type":"ContainerStarted","Data":"8fd9550fd19e0a6452b39b20bb6aeb8d6341cf2a27d7b0bca7912c3388db0cf3"} Jun 14 22:54:04.266779 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.266618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m479d" event={"ID":"61ff5caf-e213-4186-9860-81bd8ad721f9","Type":"ContainerStarted","Data":"1f5bca40ead1ba8872b16fc1427c3b40454468fac497b57245cfbba46f40f540"} Jun 14 22:54:04.267976 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.267952 2563 generic.go:356] "Generic (PLEG): container finished" podID="630efe13-5eba-484c-b336-0337d8521151" containerID="74e5a361aafe0c997ceeb8fdb9564a2a24c089a0d61e74df431585ea2f1d6a36" exitCode=0 Jun 14 22:54:04.268055 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.268033 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerDied","Data":"74e5a361aafe0c997ceeb8fdb9564a2a24c089a0d61e74df431585ea2f1d6a36"} Jun 14 22:54:04.268120 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.268107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"235a9fafef036911133a7b49ee5dba2b46d4bedf673c8ff6b836fe3a34b469e1"} Jun 14 22:54:04.282559 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:04.282518 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m479d" podStartSLOduration=374.477236435 podStartE2EDuration="6m15.282503517s" totalImagesPullingTime="805.267082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:54:04.281390043 +0000 UTC m=+375.624779870" watchObservedRunningTime="2026-06-14 22:54:04.282503517 +0000 UTC m=+375.625893347" Jun 14 22:54:05.090763 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.090719 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79eb3e58-cf30-4771-b46a-75d7e14a5010" path="/var/lib/kubelet/pods/79eb3e58-cf30-4771-b46a-75d7e14a5010/volumes" Jun 14 22:54:05.276727 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.276688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"a51613b2be38520f7415231d7e4fa1f19647ef8db83534c436a8a9aceba18976"} Jun 14 22:54:05.276930 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.276771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"47ca09940bcc181b2e8f217154b541d2815c085706ad7d92f42eb801ba631e3c"} Jun 14 22:54:05.276930 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.276817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"2cb20ca3da75ce991b7267458e6ce0db43dc979924af6d44a75bfc3833b14736"} Jun 14 22:54:05.276930 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.276855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"a54f319ed21e3a7092d85e1d81e46ef7215e9379fac0fac19569cf622d784a58"} Jun 14 22:54:05.276930 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.276893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"1ffa4349461f9250bf7cf44f6947a82e5e48d66b655f000a84067f66ea3bfe66"} Jun 14 22:54:05.276930 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.276926 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"630efe13-5eba-484c-b336-0337d8521151","Type":"ContainerStarted","Data":"f783d8255e2270bc8d9171b55b30a804f12c2dc385b8791b2bf7073d37713378"} Jun 14 22:54:05.305224 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:05.305164 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.284386809 podStartE2EDuration="2.30514769s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.760881ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:54:05.304182457 +0000 UTC m=+376.647572284" watchObservedRunningTime="2026-06-14 22:54:05.30514769 +0000 UTC m=+376.648537516" Jun 14 22:54:08.919678 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:54:08.919644 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:55:03.919679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:03.919642 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:55:03.934996 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:03.934964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:55:04.520336 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:04.520292 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 22:55:28.482561 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.482530 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4"] Jun 14 22:55:28.485898 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.485882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.488490 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.488464 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 22:55:28.488622 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.488510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:55:28.489605 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.489587 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pntm8\"" Jun 14 22:55:28.493039 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.493014 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4"] Jun 14 22:55:28.615420 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.615394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a2974b0-e0df-47c4-8f99-37b052f897a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cm7h4\" (UID: \"4a2974b0-e0df-47c4-8f99-37b052f897a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.615585 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.615434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xgt\" (UniqueName: \"kubernetes.io/projected/4a2974b0-e0df-47c4-8f99-37b052f897a0-kube-api-access-69xgt\") pod \"openshift-lws-operator-fd8ccff4c-cm7h4\" (UID: \"4a2974b0-e0df-47c4-8f99-37b052f897a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.716322 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.716268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69xgt\" (UniqueName: \"kubernetes.io/projected/4a2974b0-e0df-47c4-8f99-37b052f897a0-kube-api-access-69xgt\") pod \"openshift-lws-operator-fd8ccff4c-cm7h4\" (UID: \"4a2974b0-e0df-47c4-8f99-37b052f897a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.716480 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.716368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a2974b0-e0df-47c4-8f99-37b052f897a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cm7h4\" (UID: \"4a2974b0-e0df-47c4-8f99-37b052f897a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.716679 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.716662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a2974b0-e0df-47c4-8f99-37b052f897a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cm7h4\" (UID: \"4a2974b0-e0df-47c4-8f99-37b052f897a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.723978 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.723960 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xgt\" (UniqueName: \"kubernetes.io/projected/4a2974b0-e0df-47c4-8f99-37b052f897a0-kube-api-access-69xgt\") pod \"openshift-lws-operator-fd8ccff4c-cm7h4\" (UID: \"4a2974b0-e0df-47c4-8f99-37b052f897a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.804945 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.804882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" Jun 14 22:55:28.927360 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:28.927332 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4"] Jun 14 22:55:28.929940 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:55:28.929911 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a2974b0_e0df_47c4_8f99_37b052f897a0.slice/crio-9a32d812ba685cf5e43a4735f5cad6637e94fe1f9fe7a9af27efa5bd8ce90ac0 WatchSource:0}: Error finding container 9a32d812ba685cf5e43a4735f5cad6637e94fe1f9fe7a9af27efa5bd8ce90ac0: Status 404 returned error can't find the container with id 9a32d812ba685cf5e43a4735f5cad6637e94fe1f9fe7a9af27efa5bd8ce90ac0 Jun 14 22:55:29.595352 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:29.595298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" event={"ID":"4a2974b0-e0df-47c4-8f99-37b052f897a0","Type":"ContainerStarted","Data":"9a32d812ba685cf5e43a4735f5cad6637e94fe1f9fe7a9af27efa5bd8ce90ac0"} Jun 14 22:55:32.609462 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:32.609428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" event={"ID":"4a2974b0-e0df-47c4-8f99-37b052f897a0","Type":"ContainerStarted","Data":"c644446ffde851f6cb958df8b6c9ef27e2636ea1e9a04aac2edc7d895ff4f329"} Jun 14 22:55:32.625786 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:32.625729 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cm7h4" podStartSLOduration=1.924223786 podStartE2EDuration="4.625714148s" totalImagesPullingTime="2.701490362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:32.624234224 +0000 UTC m=+463.967624049" watchObservedRunningTime="2026-06-14 22:55:32.625714148 +0000 UTC m=+463.969103973" Jun 14 22:55:47.704253 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.704220 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72"] Jun 14 22:55:47.710034 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.710011 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.713857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.713811 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 22:55:47.713857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.713813 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 22:55:47.713857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.713843 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 22:55:47.713857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.713821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vhkcw\"" Jun 14 22:55:47.717454 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.717435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72"] Jun 14 22:55:47.777571 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.777537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mndc\" (UniqueName: \"kubernetes.io/projected/7594d8d0-bc41-4208-9432-030fba8d784d-kube-api-access-8mndc\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.777713 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.777589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7594d8d0-bc41-4208-9432-030fba8d784d-metrics-cert\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.777713 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.777607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7594d8d0-bc41-4208-9432-030fba8d784d-cert\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.777713 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.777685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7594d8d0-bc41-4208-9432-030fba8d784d-manager-config\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.878894 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.878860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7594d8d0-bc41-4208-9432-030fba8d784d-manager-config\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.879052 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.878922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mndc\" (UniqueName: \"kubernetes.io/projected/7594d8d0-bc41-4208-9432-030fba8d784d-kube-api-access-8mndc\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.879052 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.878963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7594d8d0-bc41-4208-9432-030fba8d784d-metrics-cert\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.879052 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.878985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7594d8d0-bc41-4208-9432-030fba8d784d-cert\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.879603 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.879578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7594d8d0-bc41-4208-9432-030fba8d784d-manager-config\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.881411 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.881392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7594d8d0-bc41-4208-9432-030fba8d784d-metrics-cert\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.881511 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.881440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7594d8d0-bc41-4208-9432-030fba8d784d-cert\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:47.894759 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:47.894740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mndc\" (UniqueName: \"kubernetes.io/projected/7594d8d0-bc41-4208-9432-030fba8d784d-kube-api-access-8mndc\") pod \"lws-controller-manager-59bb6ccd6d-f6g72\" (UID: \"7594d8d0-bc41-4208-9432-030fba8d784d\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:48.019841 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:48.019753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:48.146792 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:48.146768 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72"] Jun 14 22:55:48.148875 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:55:48.148847 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7594d8d0_bc41_4208_9432_030fba8d784d.slice/crio-3ed0dafab11b6060efaac2316e10367c3d6b2cebf8489b04b943abfa076b3403 WatchSource:0}: Error finding container 3ed0dafab11b6060efaac2316e10367c3d6b2cebf8489b04b943abfa076b3403: Status 404 returned error can't find the container with id 3ed0dafab11b6060efaac2316e10367c3d6b2cebf8489b04b943abfa076b3403 Jun 14 22:55:48.671962 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:48.671930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" event={"ID":"7594d8d0-bc41-4208-9432-030fba8d784d","Type":"ContainerStarted","Data":"3ed0dafab11b6060efaac2316e10367c3d6b2cebf8489b04b943abfa076b3403"} Jun 14 22:55:50.681087 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:50.681055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" event={"ID":"7594d8d0-bc41-4208-9432-030fba8d784d","Type":"ContainerStarted","Data":"7b106813f047733d5f4caa94d6d4e1d0c19d53e696bcd793105ba000ceedcaca"} Jun 14 22:55:50.681491 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:50.681125 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:55:50.702925 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:50.702877 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" podStartSLOduration=2.120068415 podStartE2EDuration="3.702863778s" totalImagesPullingTime="1.582795363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:50.700566657 +0000 UTC m=+482.043956481" watchObservedRunningTime="2026-06-14 22:55:50.702863778 +0000 UTC m=+482.046253604" Jun 14 22:55:51.596995 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.596965 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l"] Jun 14 22:55:51.601227 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.601204 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.603638 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.603606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rxwmc\"" Jun 14 22:55:51.603638 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.603630 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 22:55:51.603820 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.603749 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 22:55:51.603820 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.603755 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 22:55:51.604495 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.604482 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 22:55:51.613123 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.613101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.613222 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.613133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.613222 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.613200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vkl9\" (UniqueName: \"kubernetes.io/projected/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-kube-api-access-9vkl9\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.613348 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.613235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.613348 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.613273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.617544 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.617526 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l"] Jun 14 22:55:51.713805 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.713776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.714235 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.713809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.714235 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.713869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vkl9\" (UniqueName: \"kubernetes.io/projected/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-kube-api-access-9vkl9\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.714235 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.713909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.714235 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.713937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.714465 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.714326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.716121 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.716086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.716410 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.716390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.716475 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.716414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.722357 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.722340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vkl9\" (UniqueName: \"kubernetes.io/projected/3445deb4-5dd6-4254-b89c-5dd7c7e46ba9-kube-api-access-9vkl9\") pod \"opendatahub-operator-controller-manager-7cf75689df-6dh4l\" (UID: \"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:51.911358 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:51.911269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:52.047906 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:52.047880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l"] Jun 14 22:55:52.050408 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:55:52.050381 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3445deb4_5dd6_4254_b89c_5dd7c7e46ba9.slice/crio-7540f2e7b2ee27ff3491e629450530b2ff58e9b446f67a06bd634c618ca2a21f WatchSource:0}: Error finding container 7540f2e7b2ee27ff3491e629450530b2ff58e9b446f67a06bd634c618ca2a21f: Status 404 returned error can't find the container with id 7540f2e7b2ee27ff3491e629450530b2ff58e9b446f67a06bd634c618ca2a21f Jun 14 22:55:52.692440 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:52.692399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" event={"ID":"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9","Type":"ContainerStarted","Data":"7540f2e7b2ee27ff3491e629450530b2ff58e9b446f67a06bd634c618ca2a21f"} Jun 14 22:55:55.708138 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:55.708101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" event={"ID":"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9","Type":"ContainerStarted","Data":"61d406c1c9dc36e60e95e1788a56d6690b1db2b2e8b41f267b790156112b8287"} Jun 14 22:55:56.713108 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:56.713075 2563 generic.go:356] "Generic (PLEG): container finished" podID="3445deb4-5dd6-4254-b89c-5dd7c7e46ba9" containerID="61d406c1c9dc36e60e95e1788a56d6690b1db2b2e8b41f267b790156112b8287" exitCode=0 Jun 14 22:55:56.713108 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:56.713112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" event={"ID":"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9","Type":"ContainerDied","Data":"61d406c1c9dc36e60e95e1788a56d6690b1db2b2e8b41f267b790156112b8287"} Jun 14 22:55:57.718920 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:57.718884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" event={"ID":"3445deb4-5dd6-4254-b89c-5dd7c7e46ba9","Type":"ContainerStarted","Data":"d28aaa47985e5453580692ff9e85738d7fc8babdff042ec10fbc0dd8f7d9274c"} Jun 14 22:55:57.719282 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:57.719020 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:55:57.740501 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:55:57.740456 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" podStartSLOduration=2.7041203 podStartE2EDuration="6.740439778s" totalImagesPullingTime="3.10137309s" totalInitContainerRuntime="934.946388ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:57.738170297 +0000 UTC m=+489.081560136" watchObservedRunningTime="2026-06-14 22:55:57.740439778 +0000 UTC m=+489.083829604" Jun 14 22:56:01.688046 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:01.688015 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-f6g72" Jun 14 22:56:08.725318 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:08.725279 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-6dh4l" Jun 14 22:56:40.039063 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.038974 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc"] Jun 14 22:56:40.041386 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.041354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.045392 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.045373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-phmnq\"" Jun 14 22:56:40.045483 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.045427 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 22:56:40.060025 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.059994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc"] Jun 14 22:56:40.230723 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.230723 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k95l7\" (UniqueName: \"kubernetes.io/projected/45fc5918-ec81-4095-ad56-86d8978e5619-kube-api-access-k95l7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.230997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.230997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45fc5918-ec81-4095-ad56-86d8978e5619-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.230997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.230997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.230997 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.230962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.231243 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.231001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45fc5918-ec81-4095-ad56-86d8978e5619-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.231243 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.231050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45fc5918-ec81-4095-ad56-86d8978e5619-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332410 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332410 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45fc5918-ec81-4095-ad56-86d8978e5619-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332410 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45fc5918-ec81-4095-ad56-86d8978e5619-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332702 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332702 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332476 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95l7\" (UniqueName: \"kubernetes.io/projected/45fc5918-ec81-4095-ad56-86d8978e5619-kube-api-access-k95l7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332702 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332862 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332862 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45fc5918-ec81-4095-ad56-86d8978e5619-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332862 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.332862 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.333067 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.332863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.333219 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.333161 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.333367 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.333238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.333480 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.333445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45fc5918-ec81-4095-ad56-86d8978e5619-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.335071 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.335048 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45fc5918-ec81-4095-ad56-86d8978e5619-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.335449 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.335434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45fc5918-ec81-4095-ad56-86d8978e5619-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.345922 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.345897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45fc5918-ec81-4095-ad56-86d8978e5619-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.346177 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.346156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k95l7\" (UniqueName: \"kubernetes.io/projected/45fc5918-ec81-4095-ad56-86d8978e5619-kube-api-access-k95l7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795m5xgc\" (UID: \"45fc5918-ec81-4095-ad56-86d8978e5619\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.351853 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.351835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:40.489590 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.489565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc"] Jun 14 22:56:40.491227 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:56:40.491201 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fc5918_ec81_4095_ad56_86d8978e5619.slice/crio-4ccd41c488a8a30776b837b38f3fbd81ff0d16d4e942786ddba4daa9a78701a8 WatchSource:0}: Error finding container 4ccd41c488a8a30776b837b38f3fbd81ff0d16d4e942786ddba4daa9a78701a8: Status 404 returned error can't find the container with id 4ccd41c488a8a30776b837b38f3fbd81ff0d16d4e942786ddba4daa9a78701a8 Jun 14 22:56:40.894056 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:40.894023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" event={"ID":"45fc5918-ec81-4095-ad56-86d8978e5619","Type":"ContainerStarted","Data":"4ccd41c488a8a30776b837b38f3fbd81ff0d16d4e942786ddba4daa9a78701a8"} Jun 14 22:56:41.012772 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.012729 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7dcf6b5898-pbfj8"] Jun 14 22:56:41.017095 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.017068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.020005 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.019889 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7xlvg\"" Jun 14 22:56:41.020955 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.020931 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 22:56:41.021862 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.021838 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7dcf6b5898-pbfj8"] Jun 14 22:56:41.040231 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.040202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsqn\" (UniqueName: \"kubernetes.io/projected/e71bd95f-2aff-43f5-b726-0f0e5c0bea78-kube-api-access-lwsqn\") pod \"dashboard-redirect-7dcf6b5898-pbfj8\" (UID: \"e71bd95f-2aff-43f5-b726-0f0e5c0bea78\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.040625 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.040247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e71bd95f-2aff-43f5-b726-0f0e5c0bea78-redirect-config\") pod \"dashboard-redirect-7dcf6b5898-pbfj8\" (UID: \"e71bd95f-2aff-43f5-b726-0f0e5c0bea78\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.140965 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.140928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsqn\" (UniqueName: \"kubernetes.io/projected/e71bd95f-2aff-43f5-b726-0f0e5c0bea78-kube-api-access-lwsqn\") pod \"dashboard-redirect-7dcf6b5898-pbfj8\" (UID: \"e71bd95f-2aff-43f5-b726-0f0e5c0bea78\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.141159 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.140991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e71bd95f-2aff-43f5-b726-0f0e5c0bea78-redirect-config\") pod \"dashboard-redirect-7dcf6b5898-pbfj8\" (UID: \"e71bd95f-2aff-43f5-b726-0f0e5c0bea78\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.142014 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.141989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e71bd95f-2aff-43f5-b726-0f0e5c0bea78-redirect-config\") pod \"dashboard-redirect-7dcf6b5898-pbfj8\" (UID: \"e71bd95f-2aff-43f5-b726-0f0e5c0bea78\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.149326 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.149259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsqn\" (UniqueName: \"kubernetes.io/projected/e71bd95f-2aff-43f5-b726-0f0e5c0bea78-kube-api-access-lwsqn\") pod \"dashboard-redirect-7dcf6b5898-pbfj8\" (UID: \"e71bd95f-2aff-43f5-b726-0f0e5c0bea78\") " pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.329708 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.329674 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" Jun 14 22:56:41.472940 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.472917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7dcf6b5898-pbfj8"] Jun 14 22:56:41.475603 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:56:41.475572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71bd95f_2aff_43f5_b726_0f0e5c0bea78.slice/crio-93928b6334d171bdd25b66b32fc42b75d4392f25abd94d0fdab75a204205d9dd WatchSource:0}: Error finding container 93928b6334d171bdd25b66b32fc42b75d4392f25abd94d0fdab75a204205d9dd: Status 404 returned error can't find the container with id 93928b6334d171bdd25b66b32fc42b75d4392f25abd94d0fdab75a204205d9dd Jun 14 22:56:41.906389 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:41.906343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" event={"ID":"e71bd95f-2aff-43f5-b726-0f0e5c0bea78","Type":"ContainerStarted","Data":"93928b6334d171bdd25b66b32fc42b75d4392f25abd94d0fdab75a204205d9dd"} Jun 14 22:56:44.176518 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.176474 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:56:44.176897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.176564 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:56:44.176897 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.176615 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:56:44.922014 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.921973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" event={"ID":"45fc5918-ec81-4095-ad56-86d8978e5619","Type":"ContainerStarted","Data":"856b3edd373fe139b9220bf48db2c173886dcaff50f755441e05ab16f82963f0"} Jun 14 22:56:44.923509 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.923484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" event={"ID":"e71bd95f-2aff-43f5-b726-0f0e5c0bea78","Type":"ContainerStarted","Data":"5de018095047462f99f75212caebcbfb84a14d75b40f36f0aed9422491abf0f2"} Jun 14 22:56:44.942387 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.942342 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" podStartSLOduration=1.25925179 podStartE2EDuration="4.942301087s" totalImagesPullingTime="3.683049297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:44.940570881 +0000 UTC m=+536.283960707" watchObservedRunningTime="2026-06-14 22:56:44.942301087 +0000 UTC m=+536.285690913" Jun 14 22:56:44.955266 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:44.955215 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7dcf6b5898-pbfj8" podStartSLOduration=2.205141148 podStartE2EDuration="4.955199264s" totalImagesPullingTime="2.750058116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:44.953886837 +0000 UTC m=+536.297276663" watchObservedRunningTime="2026-06-14 22:56:44.955199264 +0000 UTC m=+536.298589090" Jun 14 22:56:45.352530 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:45.352498 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:45.357071 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:45.357048 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:45.928112 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:45.928072 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:56:45.929057 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:56:45.929038 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795m5xgc" Jun 14 22:57:11.292695 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.292659 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbw75"] Jun 14 22:57:11.296359 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.296335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:11.298980 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.298958 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 22:57:11.299111 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.298995 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 22:57:11.300165 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.300146 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qn9fk\"" Jun 14 22:57:11.305581 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.305372 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbw75"] Jun 14 22:57:11.420145 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.420113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qbr\" (UniqueName: \"kubernetes.io/projected/3a161d70-2a05-4c5c-a34c-a57a346d9ea4-kube-api-access-j6qbr\") pod \"kuadrant-operator-catalog-zbw75\" (UID: \"3a161d70-2a05-4c5c-a34c-a57a346d9ea4\") " pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:11.521479 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.521442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qbr\" (UniqueName: \"kubernetes.io/projected/3a161d70-2a05-4c5c-a34c-a57a346d9ea4-kube-api-access-j6qbr\") pod \"kuadrant-operator-catalog-zbw75\" (UID: \"3a161d70-2a05-4c5c-a34c-a57a346d9ea4\") " pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:11.529439 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.529417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qbr\" (UniqueName: \"kubernetes.io/projected/3a161d70-2a05-4c5c-a34c-a57a346d9ea4-kube-api-access-j6qbr\") pod \"kuadrant-operator-catalog-zbw75\" (UID: \"3a161d70-2a05-4c5c-a34c-a57a346d9ea4\") " pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:11.608591 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.608494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:11.661188 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.661154 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbw75"] Jun 14 22:57:11.733097 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.733066 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbw75"] Jun 14 22:57:11.736229 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:57:11.736204 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a161d70_2a05_4c5c_a34c_a57a346d9ea4.slice/crio-373c20382a748fbd615f5bc6f688feabfa229904476a45d04505d94b97750f1f WatchSource:0}: Error finding container 373c20382a748fbd615f5bc6f688feabfa229904476a45d04505d94b97750f1f: Status 404 returned error can't find the container with id 373c20382a748fbd615f5bc6f688feabfa229904476a45d04505d94b97750f1f Jun 14 22:57:11.871227 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.871146 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pbp6"] Jun 14 22:57:11.882340 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.882285 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pbp6"] Jun 14 22:57:11.882518 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:11.882423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:12.026167 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:12.026128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhl45\" (UniqueName: \"kubernetes.io/projected/96ff22de-7ce9-4938-b890-de50a43f0aab-kube-api-access-nhl45\") pod \"kuadrant-operator-catalog-4pbp6\" (UID: \"96ff22de-7ce9-4938-b890-de50a43f0aab\") " pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:12.037782 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:12.037741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" event={"ID":"3a161d70-2a05-4c5c-a34c-a57a346d9ea4","Type":"ContainerStarted","Data":"373c20382a748fbd615f5bc6f688feabfa229904476a45d04505d94b97750f1f"} Jun 14 22:57:12.127253 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:12.127165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhl45\" (UniqueName: \"kubernetes.io/projected/96ff22de-7ce9-4938-b890-de50a43f0aab-kube-api-access-nhl45\") pod \"kuadrant-operator-catalog-4pbp6\" (UID: \"96ff22de-7ce9-4938-b890-de50a43f0aab\") " pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:12.134978 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:12.134956 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhl45\" (UniqueName: \"kubernetes.io/projected/96ff22de-7ce9-4938-b890-de50a43f0aab-kube-api-access-nhl45\") pod \"kuadrant-operator-catalog-4pbp6\" (UID: \"96ff22de-7ce9-4938-b890-de50a43f0aab\") " pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:12.192673 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:12.192642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:12.331190 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:12.331165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pbp6"] Jun 14 22:57:12.332925 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:57:12.332898 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ff22de_7ce9_4938_b890_de50a43f0aab.slice/crio-f31966b55270326e0bf9bb6b0246ed7c10b68846fd890959c9c16f0a465aa08a WatchSource:0}: Error finding container f31966b55270326e0bf9bb6b0246ed7c10b68846fd890959c9c16f0a465aa08a: Status 404 returned error can't find the container with id f31966b55270326e0bf9bb6b0246ed7c10b68846fd890959c9c16f0a465aa08a Jun 14 22:57:13.045381 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:13.045341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" event={"ID":"96ff22de-7ce9-4938-b890-de50a43f0aab","Type":"ContainerStarted","Data":"f31966b55270326e0bf9bb6b0246ed7c10b68846fd890959c9c16f0a465aa08a"} Jun 14 22:57:14.050705 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.050618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" event={"ID":"96ff22de-7ce9-4938-b890-de50a43f0aab","Type":"ContainerStarted","Data":"1c1e4d3ed7f9e603ba1be7dbbf8261f2d97770878b0838b96470566491604a84"} Jun 14 22:57:14.052065 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.052038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" event={"ID":"3a161d70-2a05-4c5c-a34c-a57a346d9ea4","Type":"ContainerStarted","Data":"1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28"} Jun 14 22:57:14.052199 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.052127 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" podUID="3a161d70-2a05-4c5c-a34c-a57a346d9ea4" containerName="registry-server" containerID="cri-o://1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28" gracePeriod=2 Jun 14 22:57:14.065492 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.065443 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" podStartSLOduration=1.592808599 podStartE2EDuration="3.065424663s" totalImagesPullingTime="1.472616064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:57:14.064602008 +0000 UTC m=+565.407991834" watchObservedRunningTime="2026-06-14 22:57:14.065424663 +0000 UTC m=+565.408814488" Jun 14 22:57:14.079627 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.079581 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" podStartSLOduration=1.013055453 podStartE2EDuration="3.079565831s" totalImagesPullingTime="2.066510378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:57:14.077976282 +0000 UTC m=+565.421366110" watchObservedRunningTime="2026-06-14 22:57:14.079565831 +0000 UTC m=+565.422955656" Jun 14 22:57:14.292654 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.292628 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:14.449335 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.449285 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6qbr\" (UniqueName: \"kubernetes.io/projected/3a161d70-2a05-4c5c-a34c-a57a346d9ea4-kube-api-access-j6qbr\") pod \"3a161d70-2a05-4c5c-a34c-a57a346d9ea4\" (UID: \"3a161d70-2a05-4c5c-a34c-a57a346d9ea4\") " Jun 14 22:57:14.451428 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.451400 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a161d70-2a05-4c5c-a34c-a57a346d9ea4-kube-api-access-j6qbr" (OuterVolumeSpecName: "kube-api-access-j6qbr") pod "3a161d70-2a05-4c5c-a34c-a57a346d9ea4" (UID: "3a161d70-2a05-4c5c-a34c-a57a346d9ea4"). InnerVolumeSpecName "kube-api-access-j6qbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:57:14.550279 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:14.550246 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6qbr\" (UniqueName: \"kubernetes.io/projected/3a161d70-2a05-4c5c-a34c-a57a346d9ea4-kube-api-access-j6qbr\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:57:15.057708 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.057672 2563 generic.go:356] "Generic (PLEG): container finished" podID="3a161d70-2a05-4c5c-a34c-a57a346d9ea4" containerID="1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28" exitCode=0 Jun 14 22:57:15.058136 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.057713 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" Jun 14 22:57:15.058136 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.057754 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" event={"ID":"3a161d70-2a05-4c5c-a34c-a57a346d9ea4","Type":"ContainerDied","Data":"1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28"} Jun 14 22:57:15.058136 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.057802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbw75" event={"ID":"3a161d70-2a05-4c5c-a34c-a57a346d9ea4","Type":"ContainerDied","Data":"373c20382a748fbd615f5bc6f688feabfa229904476a45d04505d94b97750f1f"} Jun 14 22:57:15.058136 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.057825 2563 scope.go:117] "RemoveContainer" containerID="1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28" Jun 14 22:57:15.066475 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.066459 2563 scope.go:117] "RemoveContainer" containerID="1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28" Jun 14 22:57:15.066711 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:57:15.066694 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28\": container with ID starting with 1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28 not found: ID does not exist" containerID="1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28" Jun 14 22:57:15.066758 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.066721 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28"} err="failed to get container status \"1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28\": rpc error: code = NotFound desc = could not find container \"1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28\": container with ID starting with 1111452a94c84069f09bcfe419cca4d47997737e0492c4c6bc0e264febf4ff28 not found: ID does not exist" Jun 14 22:57:15.077912 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.077866 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbw75"] Jun 14 22:57:15.083658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.083638 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbw75"] Jun 14 22:57:15.089350 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:15.089322 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a161d70-2a05-4c5c-a34c-a57a346d9ea4" path="/var/lib/kubelet/pods/3a161d70-2a05-4c5c-a34c-a57a346d9ea4/volumes" Jun 14 22:57:22.192926 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:22.192890 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:22.193526 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:22.192950 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:22.215195 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:22.215173 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:23.113968 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:23.113937 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4pbp6" Jun 14 22:57:54.652931 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.652889 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v"] Jun 14 22:57:54.655354 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.653237 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a161d70-2a05-4c5c-a34c-a57a346d9ea4" containerName="registry-server" Jun 14 22:57:54.655354 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.653249 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a161d70-2a05-4c5c-a34c-a57a346d9ea4" containerName="registry-server" Jun 14 22:57:54.655354 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.653327 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a161d70-2a05-4c5c-a34c-a57a346d9ea4" containerName="registry-server" Jun 14 22:57:54.656317 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.656290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:57:54.658864 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.658840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ggxxk\"" Jun 14 22:57:54.665046 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.665022 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v"] Jun 14 22:57:54.792425 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.792391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqpf\" (UniqueName: \"kubernetes.io/projected/c2bae1c1-41d7-4c08-a838-6b34cc0a1a41-kube-api-access-xdqpf\") pod \"authorino-operator-75cc8d5cb7-jjs5v\" (UID: \"c2bae1c1-41d7-4c08-a838-6b34cc0a1a41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:57:54.893826 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.893796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqpf\" (UniqueName: \"kubernetes.io/projected/c2bae1c1-41d7-4c08-a838-6b34cc0a1a41-kube-api-access-xdqpf\") pod \"authorino-operator-75cc8d5cb7-jjs5v\" (UID: \"c2bae1c1-41d7-4c08-a838-6b34cc0a1a41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:57:54.914616 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.914544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqpf\" (UniqueName: \"kubernetes.io/projected/c2bae1c1-41d7-4c08-a838-6b34cc0a1a41-kube-api-access-xdqpf\") pod \"authorino-operator-75cc8d5cb7-jjs5v\" (UID: \"c2bae1c1-41d7-4c08-a838-6b34cc0a1a41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:57:54.966618 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:54.966591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:57:55.093705 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:55.093679 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v"] Jun 14 22:57:55.095374 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:57:55.095346 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2bae1c1_41d7_4c08_a838_6b34cc0a1a41.slice/crio-edfea927b5ae1a3496106ac6eaa6b05635be7c0236f90c9b6c52ce53bf97b0dd WatchSource:0}: Error finding container edfea927b5ae1a3496106ac6eaa6b05635be7c0236f90c9b6c52ce53bf97b0dd: Status 404 returned error can't find the container with id edfea927b5ae1a3496106ac6eaa6b05635be7c0236f90c9b6c52ce53bf97b0dd Jun 14 22:57:55.097266 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:55.097252 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:57:55.229145 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:55.229106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" event={"ID":"c2bae1c1-41d7-4c08-a838-6b34cc0a1a41","Type":"ContainerStarted","Data":"edfea927b5ae1a3496106ac6eaa6b05635be7c0236f90c9b6c52ce53bf97b0dd"} Jun 14 22:57:57.241784 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:57.241738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" event={"ID":"c2bae1c1-41d7-4c08-a838-6b34cc0a1a41","Type":"ContainerStarted","Data":"0a4772581a1f059683512f4320372eee47c7537ea7f637e27ee5799e0f1cc229"} Jun 14 22:57:57.242127 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:57.241837 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:57:57.259842 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:57:57.259801 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" podStartSLOduration=1.21899266 podStartE2EDuration="3.259786406s" totalImagesPullingTime="2.040793746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:57:57.257140548 +0000 UTC m=+608.600530375" watchObservedRunningTime="2026-06-14 22:57:57.259786406 +0000 UTC m=+608.603176277" Jun 14 22:58:02.691808 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.691769 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch"] Jun 14 22:58:02.695424 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.695402 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:02.698114 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.698091 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 22:58:02.698223 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.698163 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pgt5v\"" Jun 14 22:58:02.704850 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.704825 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch"] Jun 14 22:58:02.866843 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.866809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gl8\" (UniqueName: \"kubernetes.io/projected/e804d03c-1ba5-4d29-b6eb-c2ddba714c00-kube-api-access-b8gl8\") pod \"dns-operator-controller-manager-864dd78c4c-92fch\" (UID: \"e804d03c-1ba5-4d29-b6eb-c2ddba714c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:02.968348 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.968219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gl8\" (UniqueName: \"kubernetes.io/projected/e804d03c-1ba5-4d29-b6eb-c2ddba714c00-kube-api-access-b8gl8\") pod \"dns-operator-controller-manager-864dd78c4c-92fch\" (UID: \"e804d03c-1ba5-4d29-b6eb-c2ddba714c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:02.988545 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:02.988510 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gl8\" (UniqueName: \"kubernetes.io/projected/e804d03c-1ba5-4d29-b6eb-c2ddba714c00-kube-api-access-b8gl8\") pod \"dns-operator-controller-manager-864dd78c4c-92fch\" (UID: \"e804d03c-1ba5-4d29-b6eb-c2ddba714c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:03.006423 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:03.006389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:03.146857 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:03.146804 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch"] Jun 14 22:58:03.149144 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:58:03.149120 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode804d03c_1ba5_4d29_b6eb_c2ddba714c00.slice/crio-4fa89d9d598c6a443db04215a5e504b98570945cb0ed6d32c2595a25966232c2 WatchSource:0}: Error finding container 4fa89d9d598c6a443db04215a5e504b98570945cb0ed6d32c2595a25966232c2: Status 404 returned error can't find the container with id 4fa89d9d598c6a443db04215a5e504b98570945cb0ed6d32c2595a25966232c2 Jun 14 22:58:03.269405 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:03.269321 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" event={"ID":"e804d03c-1ba5-4d29-b6eb-c2ddba714c00","Type":"ContainerStarted","Data":"4fa89d9d598c6a443db04215a5e504b98570945cb0ed6d32c2595a25966232c2"} Jun 14 22:58:05.248014 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.247982 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb"] Jun 14 22:58:05.251313 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.251286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:05.253637 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.253617 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c6mpx\"" Jun 14 22:58:05.262177 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.262155 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb"] Jun 14 22:58:05.281658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.281635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" event={"ID":"e804d03c-1ba5-4d29-b6eb-c2ddba714c00","Type":"ContainerStarted","Data":"b521431a67a870ce4fb1306d423c66edd8865f63819229b8f03f0b1ada79bf7e"} Jun 14 22:58:05.281771 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.281756 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:05.301040 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.300998 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" podStartSLOduration=1.3902529829999999 podStartE2EDuration="3.300985476s" totalImagesPullingTime="1.910732493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:05.299760324 +0000 UTC m=+616.643150143" watchObservedRunningTime="2026-06-14 22:58:05.300985476 +0000 UTC m=+616.644375302" Jun 14 22:58:05.393479 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.393392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx58l\" (UniqueName: \"kubernetes.io/projected/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8-kube-api-access-wx58l\") pod \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" (UID: \"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:05.494078 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.494032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx58l\" (UniqueName: \"kubernetes.io/projected/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8-kube-api-access-wx58l\") pod \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" (UID: \"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:05.502596 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.502562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx58l\" (UniqueName: \"kubernetes.io/projected/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8-kube-api-access-wx58l\") pod \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" (UID: \"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:05.562164 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.562128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:05.701794 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:05.701767 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb"] Jun 14 22:58:05.703528 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:58:05.703505 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0df7190_f403_495b_a4ea_b3bbbd6d8dc8.slice/crio-cd373ccdc490dfff07833b2f257eeb3037b0aa526ac84a7e4e73d9f7ef36104d WatchSource:0}: Error finding container cd373ccdc490dfff07833b2f257eeb3037b0aa526ac84a7e4e73d9f7ef36104d: Status 404 returned error can't find the container with id cd373ccdc490dfff07833b2f257eeb3037b0aa526ac84a7e4e73d9f7ef36104d Jun 14 22:58:06.287558 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:06.287523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" event={"ID":"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8","Type":"ContainerStarted","Data":"cd373ccdc490dfff07833b2f257eeb3037b0aa526ac84a7e4e73d9f7ef36104d"} Jun 14 22:58:08.249203 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:08.249166 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jjs5v" Jun 14 22:58:08.299140 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:08.299102 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" event={"ID":"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8","Type":"ContainerStarted","Data":"d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf"} Jun 14 22:58:08.299350 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:08.299193 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:08.318345 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:08.318279 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" podStartSLOduration=1.418515524 podStartE2EDuration="3.31826419s" totalImagesPullingTime="1.899748666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:08.316898585 +0000 UTC m=+619.660288410" watchObservedRunningTime="2026-06-14 22:58:08.31826419 +0000 UTC m=+619.661654015" Jun 14 22:58:16.290329 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:16.290287 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-92fch" Jun 14 22:58:18.370678 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.370645 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb"] Jun 14 22:58:18.371083 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.370863 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" containerName="manager" containerID="cri-o://d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf" gracePeriod=2 Jun 14 22:58:18.373133 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.373079 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:18.379842 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.379817 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb"] Jun 14 22:58:18.381649 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:58:18.381612 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" is forbidden: User \"system:node:ip-10-0-128-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-136.ec2.internal' and this object" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:18.403967 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.399764 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf"] Jun 14 22:58:18.403967 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.400526 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" containerName="manager" Jun 14 22:58:18.403967 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.400544 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" containerName="manager" Jun 14 22:58:18.403967 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.400755 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" containerName="manager" Jun 14 22:58:18.405240 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.405217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:18.406116 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.406092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6649\" (UniqueName: \"kubernetes.io/projected/2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1-kube-api-access-x6649\") pod \"limitador-operator-controller-manager-859d7b78bd-9rdtf\" (UID: \"2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:18.408058 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:58:18.408021 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" is forbidden: User \"system:node:ip-10-0-128-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-136.ec2.internal' and this object" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:18.409845 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.409822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf"] Jun 14 22:58:18.506928 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.506882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6649\" (UniqueName: \"kubernetes.io/projected/2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1-kube-api-access-x6649\") pod \"limitador-operator-controller-manager-859d7b78bd-9rdtf\" (UID: \"2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:18.518765 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.518738 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6649\" (UniqueName: \"kubernetes.io/projected/2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1-kube-api-access-x6649\") pod \"limitador-operator-controller-manager-859d7b78bd-9rdtf\" (UID: \"2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:18.617570 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.617546 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:18.620494 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:58:18.620470 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" is forbidden: User \"system:node:ip-10-0-128-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-136.ec2.internal' and this object" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:18.708167 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.708135 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx58l\" (UniqueName: \"kubernetes.io/projected/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8-kube-api-access-wx58l\") pod \"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8\" (UID: \"b0df7190-f403-495b-a4ea-b3bbbd6d8dc8\") " Jun 14 22:58:18.710108 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.710081 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8-kube-api-access-wx58l" (OuterVolumeSpecName: "kube-api-access-wx58l") pod "b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" (UID: "b0df7190-f403-495b-a4ea-b3bbbd6d8dc8"). InnerVolumeSpecName "kube-api-access-wx58l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:58:18.767658 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.767631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:18.808782 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.808751 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx58l\" (UniqueName: \"kubernetes.io/projected/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8-kube-api-access-wx58l\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 22:58:18.890795 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:18.890770 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf"] Jun 14 22:58:18.892793 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:58:18.892763 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2424b2fd_8fed_4ef1_83b4_c34b9bc4d1f1.slice/crio-e477a3b64fcc3c14290f4e66b303811d10ec58e4d3afd7c7ef393fca9410e262 WatchSource:0}: Error finding container e477a3b64fcc3c14290f4e66b303811d10ec58e4d3afd7c7ef393fca9410e262: Status 404 returned error can't find the container with id e477a3b64fcc3c14290f4e66b303811d10ec58e4d3afd7c7ef393fca9410e262 Jun 14 22:58:19.088751 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:58:19.088657 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m5hsb\" is forbidden: User \"system:node:ip-10-0-128-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-136.ec2.internal' and this object" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:19.090080 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.090059 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" path="/var/lib/kubelet/pods/b0df7190-f403-495b-a4ea-b3bbbd6d8dc8/volumes" Jun 14 22:58:19.348298 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.348215 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0df7190-f403-495b-a4ea-b3bbbd6d8dc8" containerID="d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf" exitCode=0 Jun 14 22:58:19.348298 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.348260 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m5hsb" Jun 14 22:58:19.348551 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.348332 2563 scope.go:117] "RemoveContainer" containerID="d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf" Jun 14 22:58:19.350255 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.350219 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" event={"ID":"2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1","Type":"ContainerStarted","Data":"27620f976f75a4feb049990de36277d6e0ed42b61db9b7570805160550d178da"} Jun 14 22:58:19.350546 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.350276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" event={"ID":"2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1","Type":"ContainerStarted","Data":"e477a3b64fcc3c14290f4e66b303811d10ec58e4d3afd7c7ef393fca9410e262"} Jun 14 22:58:19.350546 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.350506 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:19.356887 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.356871 2563 scope.go:117] "RemoveContainer" containerID="d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf" Jun 14 22:58:19.357128 ip-10-0-128-136 kubenswrapper[2563]: E0614 22:58:19.357110 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf\": container with ID starting with d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf not found: ID does not exist" containerID="d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf" Jun 14 22:58:19.357184 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.357134 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf"} err="failed to get container status \"d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf\": rpc error: code = NotFound desc = could not find container \"d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf\": container with ID starting with d9030f992e53d7f7114e675d33889973d5b00d4082a4d0cf52ea60c3ed6cfecf not found: ID does not exist" Jun 14 22:58:19.367641 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:19.367603 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" podStartSLOduration=1.367589645 podStartE2EDuration="1.367589645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:19.366770546 +0000 UTC m=+630.710160372" watchObservedRunningTime="2026-06-14 22:58:19.367589645 +0000 UTC m=+630.710979470" Jun 14 22:58:30.357120 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:30.357088 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9rdtf" Jun 14 22:58:47.152396 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.152364 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr"] Jun 14 22:58:47.156889 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.156873 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.159763 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.159724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-86hxd\"" Jun 14 22:58:47.167787 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.167767 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr"] Jun 14 22:58:47.256093 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256287 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256460 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bls9g\" (UniqueName: \"kubernetes.io/projected/5ce62de6-0052-4d0b-9497-b1122c3a89bf-kube-api-access-bls9g\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256460 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256460 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.256460 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.256454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357645 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357645 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357885 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357885 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bls9g\" (UniqueName: \"kubernetes.io/projected/5ce62de6-0052-4d0b-9497-b1122c3a89bf-kube-api-access-bls9g\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357885 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357885 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.357885 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358155 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.357891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358155 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.358008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358155 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.358081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358319 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.358246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358385 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.358327 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358385 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.358352 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.358592 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.358568 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.360282 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.360260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.360384 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.360338 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.365145 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.365116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce62de6-0052-4d0b-9497-b1122c3a89bf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.365367 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.365351 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bls9g\" (UniqueName: \"kubernetes.io/projected/5ce62de6-0052-4d0b-9497-b1122c3a89bf-kube-api-access-bls9g\") pod \"maas-default-gateway-openshift-default-687ff6996-j4zbr\" (UID: \"5ce62de6-0052-4d0b-9497-b1122c3a89bf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.468289 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.468257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:47.603516 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.603488 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr"] Jun 14 22:58:47.604978 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:58:47.604951 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce62de6_0052_4d0b_9497_b1122c3a89bf.slice/crio-a760fbaa82fe7fa897abb63e1d5726242dc6a886d071bd8bb4188e452979b776 WatchSource:0}: Error finding container a760fbaa82fe7fa897abb63e1d5726242dc6a886d071bd8bb4188e452979b776: Status 404 returned error can't find the container with id a760fbaa82fe7fa897abb63e1d5726242dc6a886d071bd8bb4188e452979b776 Jun 14 22:58:47.607051 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.607020 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:58:47.607119 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.607079 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:58:47.607119 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:47.607108 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 22:58:48.480288 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:48.480248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" event={"ID":"5ce62de6-0052-4d0b-9497-b1122c3a89bf","Type":"ContainerStarted","Data":"58f9193ce7e6a9b9ef70f370005567b87a3089ff3d6790a10a6aa78ec38ef8ea"} Jun 14 22:58:48.480773 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:48.480319 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" event={"ID":"5ce62de6-0052-4d0b-9497-b1122c3a89bf","Type":"ContainerStarted","Data":"a760fbaa82fe7fa897abb63e1d5726242dc6a886d071bd8bb4188e452979b776"} Jun 14 22:58:48.503467 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:48.503414 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" podStartSLOduration=1.503398368 podStartE2EDuration="1.503398368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:48.500068922 +0000 UTC m=+659.843458749" watchObservedRunningTime="2026-06-14 22:58:48.503398368 +0000 UTC m=+659.846788192" Jun 14 22:58:49.469398 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:49.469362 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:49.474003 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:49.473983 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:49.484355 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:49.484332 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:58:49.484951 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:58:49.484935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 22:59:29.650435 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.650399 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2nw7m"] Jun 14 22:59:29.653988 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.653963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" Jun 14 22:59:29.656538 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.656512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 22:59:29.656538 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.656531 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-ztw8r\"" Jun 14 22:59:29.657585 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.657571 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 22:59:29.662261 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.662238 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2nw7m"] Jun 14 22:59:29.743696 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.743666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnj8\" (UniqueName: \"kubernetes.io/projected/3255b4b8-6f9e-44f5-af2b-4665eec184b0-kube-api-access-snnj8\") pod \"keycloak-operator-d67dbbb48-2nw7m\" (UID: \"3255b4b8-6f9e-44f5-af2b-4665eec184b0\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" Jun 14 22:59:29.844409 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.844374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snnj8\" (UniqueName: \"kubernetes.io/projected/3255b4b8-6f9e-44f5-af2b-4665eec184b0-kube-api-access-snnj8\") pod \"keycloak-operator-d67dbbb48-2nw7m\" (UID: \"3255b4b8-6f9e-44f5-af2b-4665eec184b0\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" Jun 14 22:59:29.853158 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.853133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnj8\" (UniqueName: \"kubernetes.io/projected/3255b4b8-6f9e-44f5-af2b-4665eec184b0-kube-api-access-snnj8\") pod \"keycloak-operator-d67dbbb48-2nw7m\" (UID: \"3255b4b8-6f9e-44f5-af2b-4665eec184b0\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" Jun 14 22:59:29.965421 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:29.965379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" Jun 14 22:59:30.094331 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:30.094296 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2nw7m"] Jun 14 22:59:30.096060 ip-10-0-128-136 kubenswrapper[2563]: W0614 22:59:30.096029 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3255b4b8_6f9e_44f5_af2b_4665eec184b0.slice/crio-ec9262d04553093beb8f1b908ab5c1500bc7257183a5ebff835dd5c178e729cf WatchSource:0}: Error finding container ec9262d04553093beb8f1b908ab5c1500bc7257183a5ebff835dd5c178e729cf: Status 404 returned error can't find the container with id ec9262d04553093beb8f1b908ab5c1500bc7257183a5ebff835dd5c178e729cf Jun 14 22:59:30.674610 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:30.674569 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" event={"ID":"3255b4b8-6f9e-44f5-af2b-4665eec184b0","Type":"ContainerStarted","Data":"ec9262d04553093beb8f1b908ab5c1500bc7257183a5ebff835dd5c178e729cf"} Jun 14 22:59:35.701380 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:35.701343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" event={"ID":"3255b4b8-6f9e-44f5-af2b-4665eec184b0","Type":"ContainerStarted","Data":"f4a95b77b2ae3d55e9a138d116ea1b8e680d616e8c8df472218f86b814b0b87d"} Jun 14 22:59:35.721477 ip-10-0-128-136 kubenswrapper[2563]: I0614 22:59:35.721424 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-2nw7m" podStartSLOduration=1.393798653 podStartE2EDuration="6.721409372s" totalImagesPullingTime="5.327610719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:59:35.719881833 +0000 UTC m=+707.063271663" watchObservedRunningTime="2026-06-14 22:59:35.721409372 +0000 UTC m=+707.064799268" Jun 14 23:01:03.117436 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:03.117406 2563 generic.go:356] "Generic (PLEG): container finished" podID="5ce62de6-0052-4d0b-9497-b1122c3a89bf" containerID="58f9193ce7e6a9b9ef70f370005567b87a3089ff3d6790a10a6aa78ec38ef8ea" exitCode=0 Jun 14 23:01:03.117832 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:03.117483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" event={"ID":"5ce62de6-0052-4d0b-9497-b1122c3a89bf","Type":"ContainerDied","Data":"58f9193ce7e6a9b9ef70f370005567b87a3089ff3d6790a10a6aa78ec38ef8ea"} Jun 14 23:01:03.117937 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:03.117921 2563 scope.go:117] "RemoveContainer" containerID="58f9193ce7e6a9b9ef70f370005567b87a3089ff3d6790a10a6aa78ec38ef8ea" Jun 14 23:01:03.118996 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:03.118971 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:01:03.119088 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:03.119031 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:01:03.119088 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:03.119063 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:01:04.128018 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:04.127968 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" event={"ID":"5ce62de6-0052-4d0b-9497-b1122c3a89bf","Type":"ContainerStarted","Data":"6dabb8d4fce952e943fafb690870539ac5a5da38cee61549b7aa0e08a0fa1488"} Jun 14 23:01:04.469290 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:04.469247 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 23:01:04.470536 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:04.470509 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j4zbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 14 23:01:04.470653 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:04.470567 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" podUID="5ce62de6-0052-4d0b-9497-b1122c3a89bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 14 23:01:04.484862 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:04.484834 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 23:01:05.469099 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:05.469061 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j4zbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 14 23:01:05.469505 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:05.469129 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" podUID="5ce62de6-0052-4d0b-9497-b1122c3a89bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 14 23:01:06.469356 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:06.469299 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j4zbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 14 23:01:06.469739 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:06.469373 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" podUID="5ce62de6-0052-4d0b-9497-b1122c3a89bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 14 23:01:07.469232 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:07.469194 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j4zbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 14 23:01:07.469467 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:07.469264 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" podUID="5ce62de6-0052-4d0b-9497-b1122c3a89bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 14 23:01:08.472623 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:08.472592 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 23:01:08.473497 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:01:08.473476 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j4zbr" Jun 14 23:05:20.165729 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.165691 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c87d57569-phzms"] Jun 14 23:05:20.169072 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.169054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.172830 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.172804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 23:05:20.173344 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.172819 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fxn5t\"" Jun 14 23:05:20.173344 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.173070 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 23:05:20.175090 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.175069 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c87d57569-phzms"] Jun 14 23:05:20.276142 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.276094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72e7ad68-232e-4ef4-afea-cca8c80fbb93-webhook-cert\") pod \"maas-controller-6c87d57569-phzms\" (UID: \"72e7ad68-232e-4ef4-afea-cca8c80fbb93\") " pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.276340 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.276149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9h26\" (UniqueName: \"kubernetes.io/projected/72e7ad68-232e-4ef4-afea-cca8c80fbb93-kube-api-access-l9h26\") pod \"maas-controller-6c87d57569-phzms\" (UID: \"72e7ad68-232e-4ef4-afea-cca8c80fbb93\") " pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.377096 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.377053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72e7ad68-232e-4ef4-afea-cca8c80fbb93-webhook-cert\") pod \"maas-controller-6c87d57569-phzms\" (UID: \"72e7ad68-232e-4ef4-afea-cca8c80fbb93\") " pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.377096 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.377098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9h26\" (UniqueName: \"kubernetes.io/projected/72e7ad68-232e-4ef4-afea-cca8c80fbb93-kube-api-access-l9h26\") pod \"maas-controller-6c87d57569-phzms\" (UID: \"72e7ad68-232e-4ef4-afea-cca8c80fbb93\") " pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.379590 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.379563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72e7ad68-232e-4ef4-afea-cca8c80fbb93-webhook-cert\") pod \"maas-controller-6c87d57569-phzms\" (UID: \"72e7ad68-232e-4ef4-afea-cca8c80fbb93\") " pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.385564 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.385537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9h26\" (UniqueName: \"kubernetes.io/projected/72e7ad68-232e-4ef4-afea-cca8c80fbb93-kube-api-access-l9h26\") pod \"maas-controller-6c87d57569-phzms\" (UID: \"72e7ad68-232e-4ef4-afea-cca8c80fbb93\") " pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.481505 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.481448 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:20.610788 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.610763 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c87d57569-phzms"] Jun 14 23:05:20.612648 ip-10-0-128-136 kubenswrapper[2563]: W0614 23:05:20.612615 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e7ad68_232e_4ef4_afea_cca8c80fbb93.slice/crio-cf38a91f07ace3c49ee01fcf0ccd22ab0e7eef4c8b9d17246bd5ac1bed4f25ce WatchSource:0}: Error finding container cf38a91f07ace3c49ee01fcf0ccd22ab0e7eef4c8b9d17246bd5ac1bed4f25ce: Status 404 returned error can't find the container with id cf38a91f07ace3c49ee01fcf0ccd22ab0e7eef4c8b9d17246bd5ac1bed4f25ce Jun 14 23:05:20.614338 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:20.614318 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 23:05:21.329874 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:21.329837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c87d57569-phzms" event={"ID":"72e7ad68-232e-4ef4-afea-cca8c80fbb93","Type":"ContainerStarted","Data":"cf38a91f07ace3c49ee01fcf0ccd22ab0e7eef4c8b9d17246bd5ac1bed4f25ce"} Jun 14 23:05:23.342643 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:23.342551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c87d57569-phzms" event={"ID":"72e7ad68-232e-4ef4-afea-cca8c80fbb93","Type":"ContainerStarted","Data":"4d73627560c7c53f2f230c82a6131980923cce4c165db60f5ecd4da69efb13c8"} Jun 14 23:05:23.343004 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:23.342664 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:05:23.358976 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:23.358920 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c87d57569-phzms" podStartSLOduration=0.987913953 podStartE2EDuration="3.358903564s" totalImagesPullingTime="2.370989611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:05:23.356409482 +0000 UTC m=+1054.699799323" watchObservedRunningTime="2026-06-14 23:05:23.358903564 +0000 UTC m=+1054.702293395" Jun 14 23:05:34.353581 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:05:34.353547 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c87d57569-phzms" Jun 14 23:15:00.140478 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.140440 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691315-j5rhc"] Jun 14 23:15:00.144014 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.143988 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:00.146546 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.146519 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bwv4g\"" Jun 14 23:15:00.159487 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.159449 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691315-j5rhc"] Jun 14 23:15:00.212705 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.212665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gth7\" (UniqueName: \"kubernetes.io/projected/7db9187d-f34c-409a-8184-da555d59c23e-kube-api-access-2gth7\") pod \"maas-api-key-cleanup-29691315-j5rhc\" (UID: \"7db9187d-f34c-409a-8184-da555d59c23e\") " pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:00.313294 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.313250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gth7\" (UniqueName: \"kubernetes.io/projected/7db9187d-f34c-409a-8184-da555d59c23e-kube-api-access-2gth7\") pod \"maas-api-key-cleanup-29691315-j5rhc\" (UID: \"7db9187d-f34c-409a-8184-da555d59c23e\") " pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:00.321996 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.321967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gth7\" (UniqueName: \"kubernetes.io/projected/7db9187d-f34c-409a-8184-da555d59c23e-kube-api-access-2gth7\") pod \"maas-api-key-cleanup-29691315-j5rhc\" (UID: \"7db9187d-f34c-409a-8184-da555d59c23e\") " pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:00.454666 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.454631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:00.799349 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.799301 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691315-j5rhc"] Jun 14 23:15:00.801298 ip-10-0-128-136 kubenswrapper[2563]: W0614 23:15:00.801265 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db9187d_f34c_409a_8184_da555d59c23e.slice/crio-eaa93dc4c7ea9bb4574bef496ff23f832658c87732824e8c91412c553f989fc5 WatchSource:0}: Error finding container eaa93dc4c7ea9bb4574bef496ff23f832658c87732824e8c91412c553f989fc5: Status 404 returned error can't find the container with id eaa93dc4c7ea9bb4574bef496ff23f832658c87732824e8c91412c553f989fc5 Jun 14 23:15:00.803200 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:00.803184 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 23:15:01.105883 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:01.105790 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" event={"ID":"7db9187d-f34c-409a-8184-da555d59c23e","Type":"ContainerStarted","Data":"eaa93dc4c7ea9bb4574bef496ff23f832658c87732824e8c91412c553f989fc5"} Jun 14 23:15:05.128587 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:05.128487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" event={"ID":"7db9187d-f34c-409a-8184-da555d59c23e","Type":"ContainerStarted","Data":"0e67c221e2b2434976fe753346bc5a7b9ef424875263e87395af5c610c6d8302"} Jun 14 23:15:05.143641 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:05.143578 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" podStartSLOduration=1.508474681 podStartE2EDuration="5.143561278s" totalImagesPullingTime="3.635086597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:15:05.143259975 +0000 UTC m=+1636.486649806" watchObservedRunningTime="2026-06-14 23:15:05.143561278 +0000 UTC m=+1636.486951106" Jun 14 23:15:06.135067 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:06.135030 2563 generic.go:356] "Generic (PLEG): container finished" podID="7db9187d-f34c-409a-8184-da555d59c23e" containerID="0e67c221e2b2434976fe753346bc5a7b9ef424875263e87395af5c610c6d8302" exitCode=0 Jun 14 23:15:06.135483 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:06.135117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" event={"ID":"7db9187d-f34c-409a-8184-da555d59c23e","Type":"ContainerDied","Data":"0e67c221e2b2434976fe753346bc5a7b9ef424875263e87395af5c610c6d8302"} Jun 14 23:15:07.276996 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:07.276969 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:07.383053 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:07.383017 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gth7\" (UniqueName: \"kubernetes.io/projected/7db9187d-f34c-409a-8184-da555d59c23e-kube-api-access-2gth7\") pod \"7db9187d-f34c-409a-8184-da555d59c23e\" (UID: \"7db9187d-f34c-409a-8184-da555d59c23e\") " Jun 14 23:15:07.385320 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:07.385287 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db9187d-f34c-409a-8184-da555d59c23e-kube-api-access-2gth7" (OuterVolumeSpecName: "kube-api-access-2gth7") pod "7db9187d-f34c-409a-8184-da555d59c23e" (UID: "7db9187d-f34c-409a-8184-da555d59c23e"). InnerVolumeSpecName "kube-api-access-2gth7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:15:07.484698 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:07.484657 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gth7\" (UniqueName: \"kubernetes.io/projected/7db9187d-f34c-409a-8184-da555d59c23e-kube-api-access-2gth7\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:15:08.145864 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:08.145835 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" Jun 14 23:15:08.146038 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:08.145886 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691315-j5rhc" event={"ID":"7db9187d-f34c-409a-8184-da555d59c23e","Type":"ContainerDied","Data":"eaa93dc4c7ea9bb4574bef496ff23f832658c87732824e8c91412c553f989fc5"} Jun 14 23:15:08.146038 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:15:08.145936 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaa93dc4c7ea9bb4574bef496ff23f832658c87732824e8c91412c553f989fc5" Jun 14 23:25:51.609602 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.609567 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr"] Jun 14 23:25:51.611991 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.609930 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db9187d-f34c-409a-8184-da555d59c23e" containerName="cleanup" Jun 14 23:25:51.611991 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.609942 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db9187d-f34c-409a-8184-da555d59c23e" containerName="cleanup" Jun 14 23:25:51.611991 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.610008 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7db9187d-f34c-409a-8184-da555d59c23e" containerName="cleanup" Jun 14 23:25:51.613175 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.613154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.615710 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.615690 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d5e070aa-openshift-default-dockercfg-7xm6x\"" Jun 14 23:25:51.631048 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.631022 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr"] Jun 14 23:25:51.682165 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-data\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682165 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-token\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682367 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-credential-socket\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682367 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-socket\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682367 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qh94\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-kube-api-access-8qh94\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682367 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istiod-ca-cert\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682494 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-certs\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682494 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-envoy\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.682494 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.682444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-podinfo\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783087 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-credential-socket\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783243 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-socket\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783243 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qh94\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-kube-api-access-8qh94\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783243 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istiod-ca-cert\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783243 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-certs\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783556 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-envoy\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783556 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-podinfo\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783556 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-data\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783556 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-token\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783556 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-credential-socket\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783556 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783543 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-socket\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783869 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-data\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.783971 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-certs\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.784033 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.783986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istiod-ca-cert\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.785540 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.785507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-envoy\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.785787 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.785770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-podinfo\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.795816 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.795792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-token\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.796213 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.796192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qh94\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-kube-api-access-8qh94\") pod \"e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:51.924559 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:51.924484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:52.068504 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.068478 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr"] Jun 14 23:25:52.070358 ip-10-0-128-136 kubenswrapper[2563]: W0614 23:25:52.070334 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a1da5d_edbf_45b9_8e25_c5f8857c7280.slice/crio-45c0cc5efe20d7514ad758f5fe2ca899ee51e4c79a9305165ee0cd01db6121b3 WatchSource:0}: Error finding container 45c0cc5efe20d7514ad758f5fe2ca899ee51e4c79a9305165ee0cd01db6121b3: Status 404 returned error can't find the container with id 45c0cc5efe20d7514ad758f5fe2ca899ee51e4c79a9305165ee0cd01db6121b3 Jun 14 23:25:52.072397 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.072365 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:25:52.072462 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.072431 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:25:52.072462 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.072457 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:25:52.244298 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.244258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" event={"ID":"83a1da5d-edbf-45b9-8e25-c5f8857c7280","Type":"ContainerStarted","Data":"e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6"} Jun 14 23:25:52.244494 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.244332 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" event={"ID":"83a1da5d-edbf-45b9-8e25-c5f8857c7280","Type":"ContainerStarted","Data":"45c0cc5efe20d7514ad758f5fe2ca899ee51e4c79a9305165ee0cd01db6121b3"} Jun 14 23:25:52.266755 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.266695 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" podStartSLOduration=1.266672352 podStartE2EDuration="1.266672352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:25:52.265156599 +0000 UTC m=+2283.608546425" watchObservedRunningTime="2026-06-14 23:25:52.266672352 +0000 UTC m=+2283.610062179" Jun 14 23:25:52.925477 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:52.925445 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:53.930903 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:53.930868 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:54.254833 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:54.254744 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:54.255740 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:54.255722 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:25:57.985135 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:57.985095 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr"] Jun 14 23:25:57.985676 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:25:57.985288 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" podUID="83a1da5d-edbf-45b9-8e25-c5f8857c7280" containerName="istio-proxy" containerID="cri-o://e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6" gracePeriod=30 Jun 14 23:26:03.147296 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.147262 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:26:03.187467 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187436 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-socket\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187485 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-token\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187503 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-certs\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187543 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-credential-socket\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187559 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istiod-ca-cert\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187579 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qh94\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-kube-api-access-8qh94\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187595 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-data\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187646 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187611 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-podinfo\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.187908 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.187658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-envoy\") pod \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\" (UID: \"83a1da5d-edbf-45b9-8e25-c5f8857c7280\") " Jun 14 23:26:03.190558 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.190513 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:03.191040 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.191001 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 23:26:03.191324 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.191285 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-data" (OuterVolumeSpecName: "istio-data") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:03.191496 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.191466 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:03.191656 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.191637 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:03.193172 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.193117 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 23:26:03.193172 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.193120 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-kube-api-access-8qh94" (OuterVolumeSpecName: "kube-api-access-8qh94") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "kube-api-access-8qh94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:26:03.193335 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.193169 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:03.193335 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.193187 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-token" (OuterVolumeSpecName: "istio-token") pod "83a1da5d-edbf-45b9-8e25-c5f8857c7280" (UID: "83a1da5d-edbf-45b9-8e25-c5f8857c7280"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:26:03.288656 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288618 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288656 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288649 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288656 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288658 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-credential-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288656 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288667 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istiod-ca-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288942 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288677 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qh94\" (UniqueName: \"kubernetes.io/projected/83a1da5d-edbf-45b9-8e25-c5f8857c7280-kube-api-access-8qh94\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288942 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288686 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-data\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288942 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288694 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-podinfo\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288942 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288701 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-istio-envoy\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.288942 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.288709 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a1da5d-edbf-45b9-8e25-c5f8857c7280-workload-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:03.296810 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.296776 2563 generic.go:356] "Generic (PLEG): container finished" podID="83a1da5d-edbf-45b9-8e25-c5f8857c7280" containerID="e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6" exitCode=0 Jun 14 23:26:03.296968 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.296828 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" Jun 14 23:26:03.296968 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.296872 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" event={"ID":"83a1da5d-edbf-45b9-8e25-c5f8857c7280","Type":"ContainerDied","Data":"e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6"} Jun 14 23:26:03.296968 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.296934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr" event={"ID":"83a1da5d-edbf-45b9-8e25-c5f8857c7280","Type":"ContainerDied","Data":"45c0cc5efe20d7514ad758f5fe2ca899ee51e4c79a9305165ee0cd01db6121b3"} Jun 14 23:26:03.296968 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.296961 2563 scope.go:117] "RemoveContainer" containerID="e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6" Jun 14 23:26:03.306142 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.306126 2563 scope.go:117] "RemoveContainer" containerID="e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6" Jun 14 23:26:03.306425 ip-10-0-128-136 kubenswrapper[2563]: E0614 23:26:03.306405 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6\": container with ID starting with e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6 not found: ID does not exist" containerID="e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6" Jun 14 23:26:03.306481 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.306433 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6"} err="failed to get container status \"e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6\": rpc error: code = NotFound desc = could not find container \"e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6\": container with ID starting with e42e1565362512d39a7b81075f84e88730b0ab1b8bf32346920818128165d0d6 not found: ID does not exist" Jun 14 23:26:03.318444 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.318421 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr"] Jun 14 23:26:03.320061 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:03.320043 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d5e070aa-openshift-default-67cb4c468-762hr"] Jun 14 23:26:04.030037 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.030005 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh"] Jun 14 23:26:04.030490 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.030464 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a1da5d-edbf-45b9-8e25-c5f8857c7280" containerName="istio-proxy" Jun 14 23:26:04.030490 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.030485 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a1da5d-edbf-45b9-8e25-c5f8857c7280" containerName="istio-proxy" Jun 14 23:26:04.030702 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.030614 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a1da5d-edbf-45b9-8e25-c5f8857c7280" containerName="istio-proxy" Jun 14 23:26:04.033806 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.033786 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.036626 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.036592 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-671a43d2-openshift-default-dockercfg-jt7dr\"" Jun 14 23:26:04.047404 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.047381 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh"] Jun 14 23:26:04.094821 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.094792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-data\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.094941 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.094843 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-envoy\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.094941 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.094890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-token\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.094941 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.094920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qf4g\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-kube-api-access-5qf4g\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.095043 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.094974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-credential-socket\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.095043 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.095001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-podinfo\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.095043 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.095029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-certs\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.095167 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.095068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-socket\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.095167 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.095151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e8bedb-fedc-448e-9190-772c06f46bbc-istiod-ca-cert\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.195909 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.195874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-data\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.195909 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.195912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-envoy\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.195936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-token\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.195960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qf4g\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-kube-api-access-5qf4g\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-credential-socket\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-podinfo\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-certs\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-socket\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e8bedb-fedc-448e-9190-772c06f46bbc-istiod-ca-cert\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-data\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.196503 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-credential-socket\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.197011 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-certs\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.197011 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.196758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-socket\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.197182 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.197150 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e8bedb-fedc-448e-9190-772c06f46bbc-istiod-ca-cert\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.198401 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.198379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-envoy\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.199086 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.199068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-podinfo\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.209409 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.209384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-token\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.209520 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.209500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qf4g\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-kube-api-access-5qf4g\") pod \"e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.345189 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.345107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:04.481163 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.481135 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh"] Jun 14 23:26:04.482930 ip-10-0-128-136 kubenswrapper[2563]: W0614 23:26:04.482903 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e8bedb_fedc_448e_9190_772c06f46bbc.slice/crio-f8ff56d8abe1edfd15fba5ec49e42bb2effc83e4d88ee0ed432077ca01b99db7 WatchSource:0}: Error finding container f8ff56d8abe1edfd15fba5ec49e42bb2effc83e4d88ee0ed432077ca01b99db7: Status 404 returned error can't find the container with id f8ff56d8abe1edfd15fba5ec49e42bb2effc83e4d88ee0ed432077ca01b99db7 Jun 14 23:26:04.485027 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.484998 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:26:04.485083 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.485055 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:26:04.485120 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:04.485083 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 23:26:05.091658 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:05.091623 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a1da5d-edbf-45b9-8e25-c5f8857c7280" path="/var/lib/kubelet/pods/83a1da5d-edbf-45b9-8e25-c5f8857c7280/volumes" Jun 14 23:26:05.308865 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:05.308830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" event={"ID":"78e8bedb-fedc-448e-9190-772c06f46bbc","Type":"ContainerStarted","Data":"652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb"} Jun 14 23:26:05.309373 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:05.308894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" event={"ID":"78e8bedb-fedc-448e-9190-772c06f46bbc","Type":"ContainerStarted","Data":"f8ff56d8abe1edfd15fba5ec49e42bb2effc83e4d88ee0ed432077ca01b99db7"} Jun 14 23:26:05.329037 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:05.328984 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" podStartSLOduration=1.328967418 podStartE2EDuration="1.328967418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:26:05.326868281 +0000 UTC m=+2296.670258132" watchObservedRunningTime="2026-06-14 23:26:05.328967418 +0000 UTC m=+2296.672357244" Jun 14 23:26:05.345602 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:05.345522 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:05.350797 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:05.350769 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:06.313655 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:06.313622 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:06.314743 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:06.314719 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:11.432381 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:11.432349 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh"] Jun 14 23:26:11.432780 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:11.432545 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" podUID="78e8bedb-fedc-448e-9190-772c06f46bbc" containerName="istio-proxy" containerID="cri-o://652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb" gracePeriod=30 Jun 14 23:26:13.986684 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:13.986658 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:14.090073 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090031 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e8bedb-fedc-448e-9190-772c06f46bbc-istiod-ca-cert\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090073 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090087 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-envoy\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090277 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090109 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-credential-socket\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090277 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090165 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-podinfo\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090277 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090186 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-certs\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090277 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090213 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qf4g\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-kube-api-access-5qf4g\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090277 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090235 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-socket\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090589 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090294 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-data\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090589 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090382 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-token\") pod \"78e8bedb-fedc-448e-9190-772c06f46bbc\" (UID: \"78e8bedb-fedc-448e-9190-772c06f46bbc\") " Jun 14 23:26:14.090589 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090472 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:14.090589 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090511 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:14.090791 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090643 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:14.090791 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090662 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e8bedb-fedc-448e-9190-772c06f46bbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 23:26:14.090902 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090794 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.090902 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090814 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-workload-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.090902 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090830 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e8bedb-fedc-448e-9190-772c06f46bbc-istiod-ca-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.090902 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.090844 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-credential-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.091411 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.091389 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:14.092786 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.092752 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 23:26:14.092891 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.092846 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-kube-api-access-5qf4g" (OuterVolumeSpecName: "kube-api-access-5qf4g") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "kube-api-access-5qf4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:26:14.093044 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.093018 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 23:26:14.093119 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.093091 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "78e8bedb-fedc-448e-9190-772c06f46bbc" (UID: "78e8bedb-fedc-448e-9190-772c06f46bbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:26:14.192104 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.192049 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-envoy\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.192104 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.192095 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-podinfo\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.192104 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.192105 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qf4g\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-kube-api-access-5qf4g\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.192104 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.192116 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-data\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.192473 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.192125 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e8bedb-fedc-448e-9190-772c06f46bbc-istio-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jun 14 23:26:14.374143 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.374046 2563 generic.go:356] "Generic (PLEG): container finished" podID="78e8bedb-fedc-448e-9190-772c06f46bbc" containerID="652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb" exitCode=0 Jun 14 23:26:14.374143 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.374087 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" Jun 14 23:26:14.374143 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.374125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" event={"ID":"78e8bedb-fedc-448e-9190-772c06f46bbc","Type":"ContainerDied","Data":"652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb"} Jun 14 23:26:14.374386 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.374176 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh" event={"ID":"78e8bedb-fedc-448e-9190-772c06f46bbc","Type":"ContainerDied","Data":"f8ff56d8abe1edfd15fba5ec49e42bb2effc83e4d88ee0ed432077ca01b99db7"} Jun 14 23:26:14.374386 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.374197 2563 scope.go:117] "RemoveContainer" containerID="652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb" Jun 14 23:26:14.383716 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.383699 2563 scope.go:117] "RemoveContainer" containerID="652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb" Jun 14 23:26:14.383954 ip-10-0-128-136 kubenswrapper[2563]: E0614 23:26:14.383936 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb\": container with ID starting with 652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb not found: ID does not exist" containerID="652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb" Jun 14 23:26:14.384021 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.383967 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb"} err="failed to get container status \"652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb\": rpc error: code = NotFound desc = could not find container \"652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb\": container with ID starting with 652ec95b6e991a101f5464a838a693bfcf7b7e8eef960d6974cd61ac0e0a07eb not found: ID does not exist" Jun 14 23:26:14.395052 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.395026 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh"] Jun 14 23:26:14.401043 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:14.401022 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-671a43d2-openshift-default-7b6f544b6-lmblh"] Jun 14 23:26:15.090263 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:15.090230 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e8bedb-fedc-448e-9190-772c06f46bbc" path="/var/lib/kubelet/pods/78e8bedb-fedc-448e-9190-772c06f46bbc/volumes" Jun 14 23:26:27.888604 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:27.888572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7dcf6b5898-pbfj8_e71bd95f-2aff-43f5-b726-0f0e5c0bea78/nginx/0.log" Jun 14 23:26:28.340484 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:28.340455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691315-j5rhc_7db9187d-f34c-409a-8184-da555d59c23e/cleanup/0.log" Jun 14 23:26:28.450053 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:28.450022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c87d57569-phzms_72e7ad68-232e-4ef4-afea-cca8c80fbb93/manager/0.log" Jun 14 23:26:28.786921 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:28.786892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-6dh4l_3445deb4-5dd6-4254-b89c-5dd7c7e46ba9/manager/0.log" Jun 14 23:26:28.794250 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:28.794230 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-6dh4l_3445deb4-5dd6-4254-b89c-5dd7c7e46ba9/copy-manifests/0.log" Jun 14 23:26:30.454278 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:30.454252 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jjs5v_c2bae1c1-41d7-4c08-a838-6b34cc0a1a41/manager/0.log" Jun 14 23:26:30.560481 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:30.560455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-92fch_e804d03c-1ba5-4d29-b6eb-c2ddba714c00/manager/0.log" Jun 14 23:26:30.776947 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:30.776878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4pbp6_96ff22de-7ce9-4938-b890-de50a43f0aab/registry-server/0.log" Jun 14 23:26:31.122820 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:31.122743 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9rdtf_2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1/manager/0.log" Jun 14 23:26:31.450776 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:31.450746 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795m5xgc_45fc5918-ec81-4095-ad56-86d8978e5619/istio-proxy/0.log" Jun 14 23:26:31.886763 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:31.886692 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/1.log" Jun 14 23:26:32.218073 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:32.218048 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b969bcd5d-t7599_e0602555-bc97-4956-ac98-e2e25de93b49/router/0.log" Jun 14 23:26:36.572052 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.572009 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxx4/must-gather-6vl98"] Jun 14 23:26:36.572489 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.572404 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e8bedb-fedc-448e-9190-772c06f46bbc" containerName="istio-proxy" Jun 14 23:26:36.572489 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.572416 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e8bedb-fedc-448e-9190-772c06f46bbc" containerName="istio-proxy" Jun 14 23:26:36.572489 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.572489 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e8bedb-fedc-448e-9190-772c06f46bbc" containerName="istio-proxy" Jun 14 23:26:36.575768 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.575752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.578590 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.578558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxx4\"/\"openshift-service-ca.crt\"" Jun 14 23:26:36.578702 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.578600 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxx4\"/\"kube-root-ca.crt\"" Jun 14 23:26:36.579713 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.579700 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jpxx4\"/\"default-dockercfg-wmz5r\"" Jun 14 23:26:36.584365 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.584341 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/must-gather-6vl98"] Jun 14 23:26:36.696101 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.696048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74878fb0-503e-4ecd-b26c-2d90ea2e573f-must-gather-output\") pod \"must-gather-6vl98\" (UID: \"74878fb0-503e-4ecd-b26c-2d90ea2e573f\") " pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.696267 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.696124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zmpt\" (UniqueName: \"kubernetes.io/projected/74878fb0-503e-4ecd-b26c-2d90ea2e573f-kube-api-access-6zmpt\") pod \"must-gather-6vl98\" (UID: \"74878fb0-503e-4ecd-b26c-2d90ea2e573f\") " pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.797193 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.797146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74878fb0-503e-4ecd-b26c-2d90ea2e573f-must-gather-output\") pod \"must-gather-6vl98\" (UID: \"74878fb0-503e-4ecd-b26c-2d90ea2e573f\") " pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.797368 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.797214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zmpt\" (UniqueName: \"kubernetes.io/projected/74878fb0-503e-4ecd-b26c-2d90ea2e573f-kube-api-access-6zmpt\") pod \"must-gather-6vl98\" (UID: \"74878fb0-503e-4ecd-b26c-2d90ea2e573f\") " pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.797501 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.797484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74878fb0-503e-4ecd-b26c-2d90ea2e573f-must-gather-output\") pod \"must-gather-6vl98\" (UID: \"74878fb0-503e-4ecd-b26c-2d90ea2e573f\") " pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.804603 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.804576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zmpt\" (UniqueName: \"kubernetes.io/projected/74878fb0-503e-4ecd-b26c-2d90ea2e573f-kube-api-access-6zmpt\") pod \"must-gather-6vl98\" (UID: \"74878fb0-503e-4ecd-b26c-2d90ea2e573f\") " pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:36.886862 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:36.886769 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/must-gather-6vl98" Jun 14 23:26:37.029469 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:37.029442 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/must-gather-6vl98"] Jun 14 23:26:37.031687 ip-10-0-128-136 kubenswrapper[2563]: W0614 23:26:37.031659 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74878fb0_503e_4ecd_b26c_2d90ea2e573f.slice/crio-df10cd45fe4ce86143590d2bc0b0782f89351c75d3bf163bd1464204bb3fb33e WatchSource:0}: Error finding container df10cd45fe4ce86143590d2bc0b0782f89351c75d3bf163bd1464204bb3fb33e: Status 404 returned error can't find the container with id df10cd45fe4ce86143590d2bc0b0782f89351c75d3bf163bd1464204bb3fb33e Jun 14 23:26:37.033815 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:37.033798 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 23:26:37.483629 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:37.483594 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/must-gather-6vl98" event={"ID":"74878fb0-503e-4ecd-b26c-2d90ea2e573f","Type":"ContainerStarted","Data":"df10cd45fe4ce86143590d2bc0b0782f89351c75d3bf163bd1464204bb3fb33e"} Jun 14 23:26:38.502718 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:38.502673 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/must-gather-6vl98" event={"ID":"74878fb0-503e-4ecd-b26c-2d90ea2e573f","Type":"ContainerStarted","Data":"7262dac4de35a96d528be48c7bb3e1f9a6e1561f31767b36924aa0d566e9529b"} Jun 14 23:26:38.503208 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:38.502725 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/must-gather-6vl98" event={"ID":"74878fb0-503e-4ecd-b26c-2d90ea2e573f","Type":"ContainerStarted","Data":"da360867bc7dfbc584a60c622c72b819aea73bf84d220e3f2e22fc133dc11dba"} Jun 14 23:26:38.519648 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:38.519598 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxx4/must-gather-6vl98" podStartSLOduration=1.590522115 podStartE2EDuration="2.519582648s" totalImagesPullingTime="929.060533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:26:38.518141851 +0000 UTC m=+2329.861531677" watchObservedRunningTime="2026-06-14 23:26:38.519582648 +0000 UTC m=+2329.862972473" Jun 14 23:26:39.642709 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:39.642670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fzztj_e2285496-6eda-4c2c-8268-1c79a6c5b035/global-pull-secret-syncer/0.log" Jun 14 23:26:39.793997 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:39.793869 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f244d_9335656f-8c59-4678-b37e-b0c6401a867f/konnectivity-agent/0.log" Jun 14 23:26:39.850762 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:39.850734 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-136.ec2.internal_43d43933e113029bd040b626c0b9543c/haproxy/0.log" Jun 14 23:26:45.037694 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:45.037655 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jjs5v_c2bae1c1-41d7-4c08-a838-6b34cc0a1a41/manager/0.log" Jun 14 23:26:45.067710 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:45.067671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-92fch_e804d03c-1ba5-4d29-b6eb-c2ddba714c00/manager/0.log" Jun 14 23:26:45.150953 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:45.150797 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4pbp6_96ff22de-7ce9-4938-b890-de50a43f0aab/registry-server/0.log" Jun 14 23:26:45.319411 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:45.319321 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9rdtf_2424b2fd-8fed-4ef1-83b4-c34b9bc4d1f1/manager/0.log" Jun 14 23:26:47.131408 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.131380 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-779546945c-qvbsc_825e414f-2f30-4d34-a255-33a8de6ff3b2/metrics-server/0.log" Jun 14 23:26:47.199081 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.199046 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9sfk2_eb6477b6-e537-4721-a375-ce3fab59fe2d/node-exporter/0.log" Jun 14 23:26:47.223508 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.223474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9sfk2_eb6477b6-e537-4721-a375-ce3fab59fe2d/kube-rbac-proxy/0.log" Jun 14 23:26:47.252466 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.252438 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9sfk2_eb6477b6-e537-4721-a375-ce3fab59fe2d/init-textfile/0.log" Jun 14 23:26:47.498908 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.498870 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-2pvdj_38e3c61b-94de-4e6e-a61f-f89ca00a6218/kube-rbac-proxy-main/0.log" Jun 14 23:26:47.533542 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.533509 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-2pvdj_38e3c61b-94de-4e6e-a61f-f89ca00a6218/kube-rbac-proxy-self/0.log" Jun 14 23:26:47.561042 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.561002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-2pvdj_38e3c61b-94de-4e6e-a61f-f89ca00a6218/openshift-state-metrics/0.log" Jun 14 23:26:47.627863 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.627827 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/prometheus/0.log" Jun 14 23:26:47.657687 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.657660 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/config-reloader/0.log" Jun 14 23:26:47.679784 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.679761 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/thanos-sidecar/0.log" Jun 14 23:26:47.707082 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.707051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/kube-rbac-proxy-web/0.log" Jun 14 23:26:47.734617 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.734542 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/kube-rbac-proxy/0.log" Jun 14 23:26:47.758525 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.758452 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/kube-rbac-proxy-thanos/0.log" Jun 14 23:26:47.782418 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.782339 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_630efe13-5eba-484c-b336-0337d8521151/init-config-reloader/0.log" Jun 14 23:26:47.857395 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.857367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-hx6j4_8f9b6aff-29fd-4172-8d23-fc4ef0bc5ddd/prometheus-operator-admission-webhook/0.log" Jun 14 23:26:47.898448 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.898422 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7648c89989-mtf54_0617e8ba-8eb8-46b4-931f-b941d102f8f7/telemeter-client/0.log" Jun 14 23:26:47.918446 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.918415 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7648c89989-mtf54_0617e8ba-8eb8-46b4-931f-b941d102f8f7/reload/0.log" Jun 14 23:26:47.939943 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:47.939912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7648c89989-mtf54_0617e8ba-8eb8-46b4-931f-b941d102f8f7/kube-rbac-proxy/0.log" Jun 14 23:26:50.995532 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:50.995495 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6"] Jun 14 23:26:51.001362 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.001324 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.008422 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.008392 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6"] Jun 14 23:26:51.055335 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.055259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-proc\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.055523 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.055393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-sys\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.055523 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.055429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-lib-modules\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.055523 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.055502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjzt\" (UniqueName: \"kubernetes.io/projected/94a83ff3-f9c4-4c28-86b9-21151d16893d-kube-api-access-jgjzt\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.055679 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.055566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-podres\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.156878 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.156835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjzt\" (UniqueName: \"kubernetes.io/projected/94a83ff3-f9c4-4c28-86b9-21151d16893d-kube-api-access-jgjzt\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.157547 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.157524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-podres\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.157953 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.157934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-proc\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.158193 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.158178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-sys\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.158417 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.158403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-lib-modules\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.158725 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.157839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-podres\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.159480 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.158363 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-sys\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.159480 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.158106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-proc\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.159618 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.158610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94a83ff3-f9c4-4c28-86b9-21151d16893d-lib-modules\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.165511 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.165491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjzt\" (UniqueName: \"kubernetes.io/projected/94a83ff3-f9c4-4c28-86b9-21151d16893d-kube-api-access-jgjzt\") pod \"perf-node-gather-daemonset-8vpt6\" (UID: \"94a83ff3-f9c4-4c28-86b9-21151d16893d\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.247128 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.247043 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-r78qs_26d35e08-ad8e-4934-9855-4f0e8cc11aff/volume-data-source-validator/0.log" Jun 14 23:26:51.315976 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.315935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:51.506331 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.502401 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6"] Jun 14 23:26:51.604683 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:51.604648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" event={"ID":"94a83ff3-f9c4-4c28-86b9-21151d16893d","Type":"ContainerStarted","Data":"920be24921802698d677525043a0405cd7d933a92b918e9f27bdf6e279111b1f"} Jun 14 23:26:52.437707 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:52.437680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfffn_2bf8ac80-66fd-47e9-bb5d-b0bf72451e24/dns/0.log" Jun 14 23:26:52.457908 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:52.457879 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rfffn_2bf8ac80-66fd-47e9-bb5d-b0bf72451e24/kube-rbac-proxy/0.log" Jun 14 23:26:52.574820 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:52.574782 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6jf4_22194b3e-c52c-4b11-ab07-e82ffee15eb8/dns-node-resolver/0.log" Jun 14 23:26:52.614107 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:52.614068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" event={"ID":"94a83ff3-f9c4-4c28-86b9-21151d16893d","Type":"ContainerStarted","Data":"fedde8201dedb74442e29405f31f293c98cd035aa91616f3e320a9b2cf792896"} Jun 14 23:26:52.614293 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:52.614259 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:26:52.629913 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:52.629852 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" podStartSLOduration=2.62983352 podStartE2EDuration="2.62983352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 23:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:26:52.629674148 +0000 UTC m=+2343.973063974" watchObservedRunningTime="2026-06-14 23:26:52.62983352 +0000 UTC m=+2343.973223345" Jun 14 23:26:53.102912 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:53.102867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8494547889-b66h8_54798eaf-0768-4926-ab0f-858325410e70/registry/0.log" Jun 14 23:26:53.167404 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:53.167352 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wx6bp_c6467c97-cfb8-4a9b-bac4-f61d0c73cacf/node-ca/0.log" Jun 14 23:26:54.067770 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:54.067737 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795m5xgc_45fc5918-ec81-4095-ad56-86d8978e5619/istio-proxy/0.log" Jun 14 23:26:54.210497 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:54.210459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/0.log" Jun 14 23:26:54.251589 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:54.251548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/1.log" Jun 14 23:26:54.415124 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:54.415056 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b969bcd5d-t7599_e0602555-bc97-4956-ac98-e2e25de93b49/router/0.log" Jun 14 23:26:55.014142 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:55.014110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8blzj_778614cd-14d0-472f-bc7e-66bd5135a807/serve-healthcheck-canary/0.log" Jun 14 23:26:55.688875 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:55.688849 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wg9qr_8530328b-17b2-4cbf-b35e-26696b9fb770/kube-rbac-proxy/0.log" Jun 14 23:26:55.712440 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:55.712408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wg9qr_8530328b-17b2-4cbf-b35e-26696b9fb770/exporter/0.log" Jun 14 23:26:55.734749 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:55.734716 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wg9qr_8530328b-17b2-4cbf-b35e-26696b9fb770/extractor/0.log" Jun 14 23:26:57.886753 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:57.886693 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7dcf6b5898-pbfj8_e71bd95f-2aff-43f5-b726-0f0e5c0bea78/nginx/0.log" Jun 14 23:26:58.061910 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:58.061876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691315-j5rhc_7db9187d-f34c-409a-8184-da555d59c23e/cleanup/0.log" Jun 14 23:26:58.151906 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:58.151817 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c87d57569-phzms_72e7ad68-232e-4ef4-afea-cca8c80fbb93/manager/0.log" Jun 14 23:26:58.240553 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:58.240522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-6dh4l_3445deb4-5dd6-4254-b89c-5dd7c7e46ba9/manager/0.log" Jun 14 23:26:58.262505 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:58.262480 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-6dh4l_3445deb4-5dd6-4254-b89c-5dd7c7e46ba9/copy-manifests/0.log" Jun 14 23:26:58.631762 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:26:58.631736 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-8vpt6" Jun 14 23:27:00.019533 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:00.019496 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59bb6ccd6d-f6g72_7594d8d0-bc41-4208-9432-030fba8d784d/manager/0.log" Jun 14 23:27:00.073661 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:00.073629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cm7h4_4a2974b0-e0df-47c4-8f99-37b052f897a0/openshift-lws-operator/0.log" Jun 14 23:27:04.681530 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:04.681488 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795m5xgc_45fc5918-ec81-4095-ad56-86d8978e5619/istio-proxy/0.log" Jun 14 23:27:04.789550 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:04.789516 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/0.log" Jun 14 23:27:04.838323 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:04.838273 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/1.log" Jun 14 23:27:04.967468 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:04.967386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b969bcd5d-t7599_e0602555-bc97-4956-ac98-e2e25de93b49/router/0.log" Jun 14 23:27:05.886720 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:05.886686 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-kmplp_d489860f-6b00-4b4d-a260-90b00a318b06/kube-storage-version-migrator-operator/1.log" Jun 14 23:27:05.887875 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:05.887839 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-kmplp_d489860f-6b00-4b4d-a260-90b00a318b06/kube-storage-version-migrator-operator/0.log" Jun 14 23:27:06.063841 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:06.063810 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795m5xgc_45fc5918-ec81-4095-ad56-86d8978e5619/istio-proxy/0.log" Jun 14 23:27:06.170223 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:06.170151 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/0.log" Jun 14 23:27:06.216945 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:06.216909 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/1.log" Jun 14 23:27:06.345840 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:06.345808 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b969bcd5d-t7599_e0602555-bc97-4956-ac98-e2e25de93b49/router/0.log" Jun 14 23:27:07.026040 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.026006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/kube-multus-additional-cni-plugins/0.log" Jun 14 23:27:07.046980 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.046953 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/egress-router-binary-copy/0.log" Jun 14 23:27:07.070104 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.070073 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/cni-plugins/0.log" Jun 14 23:27:07.091654 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.091626 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/bond-cni-plugin/0.log" Jun 14 23:27:07.111742 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.111710 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/routeoverride-cni/0.log" Jun 14 23:27:07.131120 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.131092 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/whereabouts-cni-bincopy/0.log" Jun 14 23:27:07.151051 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.151024 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c29ds_94011f2d-9bdb-4eda-a7cb-a38279ec0deb/whereabouts-cni/0.log" Jun 14 23:27:07.468664 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.468639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pgfrr_e71b6809-1fcc-40cd-bd78-73c7e8e7ea4a/kube-multus/0.log" Jun 14 23:27:07.532252 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.532223 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m479d_61ff5caf-e213-4186-9860-81bd8ad721f9/network-metrics-daemon/0.log" Jun 14 23:27:07.550615 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.550588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m479d_61ff5caf-e213-4186-9860-81bd8ad721f9/kube-rbac-proxy/0.log" Jun 14 23:27:07.901430 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:07.901406 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795m5xgc_45fc5918-ec81-4095-ad56-86d8978e5619/istio-proxy/0.log" Jun 14 23:27:08.003713 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:08.003658 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/0.log" Jun 14 23:27:08.047301 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:08.047263 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j4zbr_5ce62de6-0052-4d0b-9497-b1122c3a89bf/istio-proxy/1.log" Jun 14 23:27:08.169070 ip-10-0-128-136 kubenswrapper[2563]: I0614 23:27:08.168953 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b969bcd5d-t7599_e0602555-bc97-4956-ac98-e2e25de93b49/router/0.log"