Jun 06 16:47:48.442773 ip-10-0-133-67 systemd[1]: Starting Kubernetes Kubelet... Jun 06 16:47:48.851383 ip-10-0-133-67 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 16:47:48.851383 ip-10-0-133-67 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 16:47:48.851383 ip-10-0-133-67 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 16:47:48.851383 ip-10-0-133-67 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 16:47:48.851383 ip-10-0-133-67 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 16:47:48.852957 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.852867 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 16:47:48.856389 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856373 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:48.856389 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856389 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856393 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856396 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856399 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856404 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856407 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856410 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856412 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856415 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856417 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856420 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856423 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856426 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856429 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856447 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856452 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856455 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856460 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856464 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856466 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:48.856469 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856469 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856472 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856474 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856477 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856480 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856483 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856486 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856488 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856491 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856493 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856496 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856498 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856501 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856504 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856507 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856509 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856512 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856514 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856517 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856520 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:48.856951 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856522 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856525 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856528 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856530 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856532 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856535 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856537 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856540 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856542 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856544 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856547 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856550 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856552 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856555 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856558 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856564 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856568 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856571 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856574 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:48.857450 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856577 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856580 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856583 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856585 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856588 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856590 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856593 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856596 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856598 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856601 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856603 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856606 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856609 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856612 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856614 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856617 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856619 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856623 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856625 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856628 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:48.857913 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856630 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856633 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856635 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856638 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856640 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856643 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856645 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856648 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856651 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856654 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856658 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856661 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856664 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856667 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856670 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856674 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856678 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856681 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.856684 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:48.858409 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857384 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857391 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857394 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857397 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857400 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857403 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857406 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857409 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857411 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857414 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857417 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857422 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857426 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857446 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857450 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857453 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857458 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857462 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857465 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:48.858877 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857468 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857471 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857474 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857477 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857480 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857483 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857485 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857488 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857490 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857493 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857496 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857499 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857502 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857505 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857507 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857509 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857513 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857515 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857518 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857521 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:48.859342 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857524 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857527 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857529 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857532 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857534 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857537 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857539 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857542 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857544 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857547 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857550 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857553 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857555 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857558 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857560 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857562 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857565 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857568 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857571 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:48.859839 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857573 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857575 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857578 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857581 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857584 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857587 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857590 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857593 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857596 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857599 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857602 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857604 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857607 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857609 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857612 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857615 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857617 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857620 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857623 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857625 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:48.860319 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857628 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857630 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857633 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857636 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857639 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857642 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857644 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857647 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857649 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857651 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857654 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857656 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857659 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857664 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857666 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857669 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857672 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857674 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857676 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857679 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:48.860822 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.857682 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858051 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858055 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858058 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858061 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858067 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858071 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858074 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858077 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858080 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858082 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858085 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858088 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858090 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858093 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858095 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858098 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858100 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858103 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858105 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:48.861326 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858108 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858110 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858113 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858115 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858136 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858142 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858146 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858149 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858152 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858154 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858157 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858160 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858162 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858165 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858168 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858171 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858174 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858176 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858179 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:48.861814 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858182 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858185 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858187 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858190 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858194 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858197 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858200 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858203 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858205 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858208 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858211 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858214 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858216 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858219 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858221 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858224 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858226 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858228 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858233 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:48.862312 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858235 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858238 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858240 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858243 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858245 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858249 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858252 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858255 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858258 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858261 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858264 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858267 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858270 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858273 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858276 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858278 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858281 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858284 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858287 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:48.862798 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858290 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858293 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858295 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858298 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858300 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858302 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858305 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858307 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858310 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858312 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858315 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858317 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858321 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858324 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858327 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858329 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858331 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858334 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858337 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858339 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:48.863250 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858342 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858347 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.858349 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858416 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858424 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858443 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858448 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858452 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858455 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858460 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858464 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858467 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858470 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858474 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858477 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858481 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858484 2572 flags.go:64] FLAG: --cgroup-root="" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858486 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858489 2572 flags.go:64] FLAG: --client-ca-file="" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858492 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858495 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858500 2572 flags.go:64] FLAG: --cluster-domain="" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858503 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 16:47:48.863758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858506 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858511 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858514 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858523 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858526 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858529 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858533 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858536 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858539 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858542 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858546 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858549 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858553 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858556 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858559 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858562 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858565 2572 flags.go:64] FLAG: --enable-server="true" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858568 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858573 2572 flags.go:64] FLAG: --event-burst="100" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858576 2572 flags.go:64] FLAG: --event-qps="50" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858578 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858581 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858584 2572 flags.go:64] FLAG: --eviction-hard="" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858588 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 16:47:48.864316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858591 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858594 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858597 2572 flags.go:64] FLAG: --eviction-soft="" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858600 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858602 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858605 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858608 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858611 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858614 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858618 2572 flags.go:64] FLAG: --feature-gates="" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858622 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858625 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858628 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858631 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858634 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858637 2572 flags.go:64] FLAG: --help="false" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858640 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-67.ec2.internal" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858643 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858647 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858650 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858654 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858657 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858660 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 16:47:48.864952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858662 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858665 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858668 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858671 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858675 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858677 2572 flags.go:64] FLAG: --kube-reserved="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858680 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858683 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858686 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858689 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858691 2572 flags.go:64] FLAG: --lock-file="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858694 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858697 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858700 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858705 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858708 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858710 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858714 2572 flags.go:64] FLAG: --logging-format="text" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858718 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858721 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858724 2572 flags.go:64] FLAG: --manifest-url="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858726 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858730 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858733 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858737 2572 flags.go:64] FLAG: --max-pods="110" Jun 06 16:47:48.865626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858740 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858743 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858747 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858750 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858753 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858756 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858759 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858766 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858769 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858772 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858775 2572 flags.go:64] FLAG: --pod-cidr="" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858778 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858783 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858786 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858789 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858792 2572 flags.go:64] FLAG: --port="10250" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858795 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858798 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-070ee04da8cecbff6" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858801 2572 flags.go:64] FLAG: --qos-reserved="" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858804 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858807 2572 flags.go:64] FLAG: --register-node="true" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858810 2572 flags.go:64] FLAG: --register-with-taints="" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858813 2572 flags.go:64] FLAG: --registry-burst="10" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858816 2572 flags.go:64] FLAG: --registry-qps="5" Jun 06 16:47:48.866233 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858819 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858823 2572 flags.go:64] FLAG: --reserved-memory="" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858827 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858830 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858833 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858836 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858839 2572 flags.go:64] FLAG: --runonce="false" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858841 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858844 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858847 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858850 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858854 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858857 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858860 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858864 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858866 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858869 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858872 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858875 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858878 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858882 2572 flags.go:64] FLAG: --system-cgroups="" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858885 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858890 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858893 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858895 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 16:47:48.866872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858900 2572 flags.go:64] FLAG: --tls-min-version="" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858903 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858906 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858909 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858912 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858915 2572 flags.go:64] FLAG: --v="2" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858919 2572 flags.go:64] FLAG: --version="false" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858923 2572 flags.go:64] FLAG: --vmodule="" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858927 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.858930 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859049 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859053 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859057 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859059 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859062 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859065 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859067 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859070 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859075 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859077 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859080 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859083 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:48.867500 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859086 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859089 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859092 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859094 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859097 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859101 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859105 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859108 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859111 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859115 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859117 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859120 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859122 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859125 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859127 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859130 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859132 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859135 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859137 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859140 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:48.868200 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859142 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859145 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859147 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859150 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859153 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859155 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859158 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859161 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859165 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859168 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859171 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859173 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859176 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859179 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859181 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859184 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859186 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859189 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859192 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:48.869017 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859195 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859197 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859200 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859202 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859205 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859207 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859210 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859213 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859216 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859218 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859221 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859223 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859226 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859228 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859232 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859235 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859238 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859242 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859245 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:48.869578 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859247 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859250 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859254 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859256 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859259 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859262 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859264 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859267 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859270 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859272 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859275 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859278 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859280 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859283 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859286 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859289 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859291 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859294 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859296 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859299 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:48.870087 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859301 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859304 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859306 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859309 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859312 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859315 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859319 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859321 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.859324 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.859819 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.866796 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.866812 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.866831 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.866840 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 16:47:48.870649 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866907 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866913 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866917 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866920 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866923 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866926 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866929 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866932 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866935 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866938 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866942 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866945 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866948 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866952 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866954 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866957 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866960 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866963 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866966 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:48.871043 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866969 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866972 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866974 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866977 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866979 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866982 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866985 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866987 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866990 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866992 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866996 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.866999 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867002 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867004 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867007 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867009 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867012 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867014 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867017 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867020 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:48.871656 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867022 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867025 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867028 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867032 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867035 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867037 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867040 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867042 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867045 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867047 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867050 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867053 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867055 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867058 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867060 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867063 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867065 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867068 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867070 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:48.872169 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867073 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867076 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867078 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867082 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867085 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867088 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867090 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867093 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867095 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867098 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867101 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867104 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867107 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867110 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867112 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867115 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867117 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867120 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867123 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:48.872661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867125 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867128 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867130 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867133 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867135 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867138 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867140 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867143 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867146 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867148 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867151 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867153 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867156 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867158 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867161 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867163 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867167 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867169 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867172 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867175 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867177 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:48.873120 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867179 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.867184 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867293 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867298 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867301 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867304 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867307 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867310 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867313 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867315 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867318 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867321 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867324 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867327 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867329 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 16:47:48.873647 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867331 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867334 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867336 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867339 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867342 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867345 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867347 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867350 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867352 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867355 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867358 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867360 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867363 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867365 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867368 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867371 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867374 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867376 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867379 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867381 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 16:47:48.874020 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867384 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867387 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867390 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867392 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867395 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867397 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867399 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867402 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867404 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867407 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867409 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867412 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867414 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867417 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867420 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867422 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867425 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867427 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867445 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867450 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 16:47:48.874554 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867452 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867455 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867458 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867460 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867463 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867466 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867470 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867473 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867476 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867479 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867481 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867484 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867486 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867489 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867492 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867494 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867497 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867499 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867502 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867505 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 06 16:47:48.875029 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867507 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867510 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867513 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867516 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867520 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867523 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867526 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867529 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867531 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867534 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867537 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867539 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867542 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867545 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867547 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867550 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867553 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867555 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867558 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 16:47:48.875593 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867560 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867563 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867566 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867568 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867571 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867573 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:48.867577 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.867583 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.867783 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.871521 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.873026 2572 server.go:1019] "Starting client certificate rotation" Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.873121 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.873151 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 16:47:48.876058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.875616 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 16:47:48.879736 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.879720 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 16:47:48.891351 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.891326 2572 log.go:25] "Validated CRI v1 runtime API" Jun 06 16:47:48.893697 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.893678 2572 log.go:25] "Validated CRI v1 image API" Jun 06 16:47:48.894603 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.894576 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 16:47:48.897496 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.897471 2572 fs.go:135] Filesystem UUIDs: map[393424a1-328b-4051-a5ec-4ab981edf8bb:/dev/nvme0n1p3 4f8e256b-5ac5-4f9c-92c1-6169c01f4a93:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 06 16:47:48.897556 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.897496 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 16:47:48.900586 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.900568 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 16:47:48.903497 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.903361 2572 manager.go:216] Machine: {Timestamp:2026-06-06 16:47:48.901590673 +0000 UTC m=+0.334428196 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105071 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce8a5cad3df5170b6520e171b9242 SystemUUID:ec2ce8a5-cad3-df51-70b6-520e171b9242 BootID:2d3556d9-49c7-4e28-8423-73cce1f638dd Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:f7:2b:09:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:f7:2b:09:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:cd:43:5d:55:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 16:47:48.903497 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.903496 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 16:47:48.903598 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.903577 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 16:47:48.907683 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.907658 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 16:47:48.907818 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.907688 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 16:47:48.908319 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.908309 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 16:47:48.908352 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.908320 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 16:47:48.908352 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.908333 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 16:47:48.908978 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.908967 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 16:47:48.909631 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.909622 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 16:47:48.912055 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912044 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 06 16:47:48.912199 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912189 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 16:47:48.912235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912221 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 06 16:47:48.912235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912231 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 16:47:48.912289 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912244 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 16:47:48.912289 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912270 2572 kubelet.go:398] "Adding apiserver pod source" Jun 06 16:47:48.912289 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912282 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 16:47:48.912864 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912843 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 16:47:48.912928 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.912879 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 16:47:48.918775 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.918743 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 16:47:48.919353 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.919332 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6jpfq" Jun 06 16:47:48.920053 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920038 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 16:47:48.920163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920075 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 16:47:48.920774 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920760 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 16:47:48.920822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920781 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 16:47:48.920822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920788 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 16:47:48.920822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920794 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 16:47:48.920822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920806 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 16:47:48.920822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920813 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 16:47:48.920986 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920978 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 16:47:48.921015 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920987 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 16:47:48.921015 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.920998 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 16:47:48.921015 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.921008 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 16:47:48.921091 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.921022 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 16:47:48.921091 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.921031 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 16:47:48.921305 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.921283 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 16:47:48.921382 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.921362 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 16:47:48.921801 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.921790 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 16:47:48.921834 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.921803 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 16:47:48.924117 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.924101 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 16:47:48.925031 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.925018 2572 server.go:1268] "Started kubelet" Jun 06 16:47:48.925116 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.925090 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 16:47:48.925236 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.925178 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 16:47:48.925290 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.925257 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 16:47:48.926295 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.926277 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6jpfq" Jun 06 16:47:48.926766 ip-10-0-133-67 systemd[1]: Started Kubernetes Kubelet. Jun 06 16:47:48.927190 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.927095 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 16:47:48.927834 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.927821 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 06 16:47:48.931579 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.930655 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-67.ec2.internal.18b68bd97ee93933 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-67.ec2.internal,UID:ip-10-0-133-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-67.ec2.internal,},FirstTimestamp:2026-06-06 16:47:48.924987699 +0000 UTC m=+0.357825222,LastTimestamp:2026-06-06 16:47:48.924987699 +0000 UTC m=+0.357825222,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-67.ec2.internal,}" Jun 06 16:47:48.931748 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.931726 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 16:47:48.931748 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.931734 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 16:47:48.931898 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.931870 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:48.932378 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932361 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 16:47:48.932482 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932396 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 16:47:48.932482 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932371 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 16:47:48.932562 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932505 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 06 16:47:48.932562 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932519 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 06 16:47:48.933289 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932893 2572 factory.go:55] Registering systemd factory Jun 06 16:47:48.933289 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.932912 2572 factory.go:223] Registration of the systemd container factory successfully Jun 06 16:47:48.933524 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.933508 2572 factory.go:153] Registering CRI-O factory Jun 06 16:47:48.933596 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.933527 2572 factory.go:223] Registration of the crio container factory successfully Jun 06 16:47:48.933596 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.933575 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 16:47:48.933596 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.933596 2572 factory.go:103] Registering Raw factory Jun 06 16:47:48.933730 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.933610 2572 manager.go:1196] Started watching for new ooms in manager Jun 06 16:47:48.934399 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.934057 2572 manager.go:349] Starting recovery of all containers Jun 06 16:47:48.935193 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.935092 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 16:47:48.939266 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.939250 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:48.941812 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.941745 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 16:47:48.942267 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.942239 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-67.ec2.internal\" not found" node="ip-10-0-133-67.ec2.internal" Jun 06 16:47:48.947213 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.947193 2572 manager.go:354] Recovery completed Jun 06 16:47:48.948485 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.948462 2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 06 16:47:48.951571 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.951481 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:48.953331 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953204 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:48.953379 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953347 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:48.953379 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953361 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:48.953916 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953897 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 16:47:48.953984 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953916 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 16:47:48.953984 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953905 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:48.953984 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.953938 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 06 16:47:48.954652 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.954638 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:48.954699 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.954668 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:48.954699 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.954681 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:48.955108 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.955097 2572 policy_none.go:49] "None policy: Start" Jun 06 16:47:48.955146 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.955111 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 16:47:48.955146 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.955121 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 16:47:48.955928 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.955918 2572 policy_none.go:47] "Start" Jun 06 16:47:48.988195 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988178 2572 manager.go:337] "Starting Device Plugin manager" Jun 06 16:47:48.988299 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.988215 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 16:47:48.988299 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988227 2572 server.go:87] "Starting device plugin registration server" Jun 06 16:47:48.988541 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988528 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 16:47:48.988581 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988543 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 16:47:48.988903 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988879 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 16:47:48.989004 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988962 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 16:47:48.989004 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:48.988972 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 16:47:48.989490 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.989471 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 16:47:48.989577 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:48.989513 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.003775 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.003755 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 16:47:49.004529 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.003792 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 16:47:49.004529 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.003813 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 16:47:49.004529 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.003877 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 16:47:49.005886 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.005868 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:49.088945 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.088912 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:49.090344 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.090328 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:49.090412 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.090359 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:49.090412 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.090371 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:49.090488 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.090427 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.096102 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.095969 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.096102 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.095995 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-67.ec2.internal\": node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.104253 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.104193 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal"] Jun 06 16:47:49.104253 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.104253 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:49.106282 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.106264 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:49.106354 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.106300 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:49.106354 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.106314 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:49.107443 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.107422 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:49.107525 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.107511 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.107562 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.107542 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:49.108619 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.108604 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.108993 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.108978 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:49.109062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.109000 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:49.109062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.109010 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:49.109062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.109051 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:49.109199 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.109075 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:49.109199 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.109089 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:49.110231 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.110215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.110299 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.110254 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 16:47:49.112187 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.112170 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientMemory" Jun 06 16:47:49.112250 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.112202 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 16:47:49.112250 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.112215 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeHasSufficientPID" Jun 06 16:47:49.124971 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.124949 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-67.ec2.internal\" not found" node="ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.129269 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.129250 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-67.ec2.internal\" not found" node="ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.133348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.133332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b77a3d35a85da5c6ed251539a21fda5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-67.ec2.internal\" (UID: \"0b77a3d35a85da5c6ed251539a21fda5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.133420 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.133356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af46534d1c16173c477c4be6e514c2c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"af46534d1c16173c477c4be6e514c2c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.133420 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.133373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af46534d1c16173c477c4be6e514c2c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"af46534d1c16173c477c4be6e514c2c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.209048 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.209016 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.234371 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.234336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b77a3d35a85da5c6ed251539a21fda5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-67.ec2.internal\" (UID: \"0b77a3d35a85da5c6ed251539a21fda5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.234371 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.234376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af46534d1c16173c477c4be6e514c2c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"af46534d1c16173c477c4be6e514c2c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.234508 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.234397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af46534d1c16173c477c4be6e514c2c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"af46534d1c16173c477c4be6e514c2c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.234508 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.234447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af46534d1c16173c477c4be6e514c2c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"af46534d1c16173c477c4be6e514c2c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.234508 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.234447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b77a3d35a85da5c6ed251539a21fda5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-67.ec2.internal\" (UID: \"0b77a3d35a85da5c6ed251539a21fda5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.234508 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.234469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af46534d1c16173c477c4be6e514c2c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal\" (UID: \"af46534d1c16173c477c4be6e514c2c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.309535 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.309490 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.410180 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.410105 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.429421 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.429394 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.433385 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.433370 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" Jun 06 16:47:49.511017 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.510977 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.611535 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.611510 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.712049 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.711987 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.752023 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.751994 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:49.813035 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.813003 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.872552 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.872523 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 16:47:49.873080 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.872676 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 16:47:49.873080 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.872701 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 16:47:49.873080 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.872707 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 16:47:49.886133 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:49.886105 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf46534d1c16173c477c4be6e514c2c6.slice/crio-ee0b51218faacf940265444275179b7bb898e443176ece1c6d0786de8b6c28fd WatchSource:0}: Error finding container ee0b51218faacf940265444275179b7bb898e443176ece1c6d0786de8b6c28fd: Status 404 returned error can't find the container with id ee0b51218faacf940265444275179b7bb898e443176ece1c6d0786de8b6c28fd Jun 06 16:47:49.886644 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:49.886625 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b77a3d35a85da5c6ed251539a21fda5.slice/crio-d59108b729f07b1e52271b397a38ee7caa8cc624be546556c86a74971503604d WatchSource:0}: Error finding container d59108b729f07b1e52271b397a38ee7caa8cc624be546556c86a74971503604d: Status 404 returned error can't find the container with id d59108b729f07b1e52271b397a38ee7caa8cc624be546556c86a74971503604d Jun 06 16:47:49.890574 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.890541 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 16:47:49.914053 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:49.914030 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:49.929904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.929878 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 16:42:48 +0000 UTC" deadline="2028-01-31 10:33:00.942950108 +0000 UTC" Jun 06 16:47:49.929987 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:49.929906 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14489h45m11.013047496s" Jun 06 16:47:50.007463 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.007348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" event={"ID":"af46534d1c16173c477c4be6e514c2c6","Type":"ContainerStarted","Data":"ee0b51218faacf940265444275179b7bb898e443176ece1c6d0786de8b6c28fd"} Jun 06 16:47:50.008413 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.008390 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" event={"ID":"0b77a3d35a85da5c6ed251539a21fda5","Type":"ContainerStarted","Data":"d59108b729f07b1e52271b397a38ee7caa8cc624be546556c86a74971503604d"} Jun 06 16:47:50.014580 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.014561 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:50.115086 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.115057 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:50.215631 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.215594 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:50.316160 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.316079 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-67.ec2.internal\" not found" Jun 06 16:47:50.407673 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.407512 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:50.432155 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.432123 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" Jun 06 16:47:50.444052 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.443925 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 16:47:50.445417 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.445387 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" Jun 06 16:47:50.453134 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.453054 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 16:47:50.913812 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.913762 2572 apiserver.go:52] "Watching apiserver" Jun 06 16:47:50.920954 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.920921 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 16:47:50.921334 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.921305 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-shnng","openshift-ovn-kubernetes/ovnkube-node-mc8c2","kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal","openshift-dns/node-resolver-96bcr","openshift-image-registry/node-ca-bshh4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal","openshift-network-diagnostics/network-check-target-9kxtn","openshift-network-operator/iptables-alerter-k5ck6","kube-system/global-pull-secret-syncer-642vt","kube-system/konnectivity-agent-9sm4t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng","openshift-cluster-node-tuning-operator/tuned-zjr2h","openshift-multus/multus-additional-cni-plugins-tgk68","openshift-multus/multus-p7wtb"] Jun 06 16:47:50.923951 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.923923 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:50.924080 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.924007 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:47:50.926097 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.926068 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.928250 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.928228 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.928932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.928639 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 16:47:50.928932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.928730 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.928932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.928741 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wlsrw\"" Jun 06 16:47:50.928932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.928641 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.929164 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.928968 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 16:47:50.929164 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.929013 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 16:47:50.930304 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.930281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:50.931102 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.931071 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ns8dn\"" Jun 06 16:47:50.931221 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.931146 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 16:47:50.932385 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.932365 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 16:47:50.932518 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.932493 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:50.932674 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.932657 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.932747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.932683 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.932839 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.932822 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b9glt\"" Jun 06 16:47:50.934899 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.934625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:50.934899 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.934855 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.935156 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.935138 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 16:47:50.935257 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.935145 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.935336 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.935318 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kr2z4\"" Jun 06 16:47:50.936900 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.936876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:50.937003 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.936950 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:47:50.937069 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.937031 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.937259 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.937237 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdpn4\"" Jun 06 16:47:50.937259 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.937256 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.937418 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.937355 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 16:47:50.939216 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.939200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:50.939287 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:50.939267 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:47:50.941609 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.941592 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:50.943617 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-system-cni-dir\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.943708 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-os-release\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.943708 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-kubelet\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.943708 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943678 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8nnl\" (UniqueName: \"kubernetes.io/projected/bb76a589-8bc2-4d18-9930-a9faaf997801-kube-api-access-g8nnl\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:50.943708 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943755 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-cni-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6sv8\" (UniqueName: \"kubernetes.io/projected/c9bedaf8-c988-4514-b190-1cce9f971446-kube-api-access-j6sv8\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb76a589-8bc2-4d18-9930-a9faaf997801-host\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb76a589-8bc2-4d18-9930-a9faaf997801-serviceca\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-iptables-alerter-script\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:50.943906 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-cni-multus\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.944230 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9wjb\" (UniqueName: \"kubernetes.io/projected/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-kube-api-access-g9wjb\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:50.944230 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.943967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-os-release\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.944230 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-socket-dir-parent\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.944230 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944129 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:50.944230 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-netns\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-cni-bin\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-hostroot\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-conf-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-host-slash\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944819 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-multus-certs\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944874 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-etc-kubernetes\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.945170 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.945710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.945391 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r4dzk\"" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.945828 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.944940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9bedaf8-c988-4514-b190-1cce9f971446-hosts-file\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.945920 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.945947 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9bedaf8-c988-4514-b190-1cce9f971446-tmp-dir\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.945980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-daemon-config\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-system-cni-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-cnibin\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41092481-72ad-4ed6-ac52-65c06c04d5bb-cni-binary-copy\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-k8s-cni-cncf-io\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cnibin\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.946235 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjzs8\" (UniqueName: \"kubernetes.io/projected/41092481-72ad-4ed6-ac52-65c06c04d5bb-kube-api-access-bjzs8\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:50.946883 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.946883 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946317 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrlkk\" (UniqueName: \"kubernetes.io/projected/85a9f767-0b05-4ebf-a348-cc02ea89adb4-kube-api-access-rrlkk\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:50.946883 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946696 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 16:47:50.946883 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946716 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.946883 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946725 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 16:47:50.947110 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946905 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 16:47:50.947110 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.946926 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x5nks\"" Jun 06 16:47:50.947549 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.947529 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:50.948045 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.948022 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 16:47:50.950023 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.950002 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 16:47:50.950125 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.950111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:50.950180 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.950140 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zwsp5\"" Jun 06 16:47:50.950522 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.950505 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.951016 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.950993 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.952190 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.952173 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:47:50.952698 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.952678 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 16:47:50.952773 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.952681 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2mpq\"" Jun 06 16:47:50.965993 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.965913 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbkp4" Jun 06 16:47:50.973288 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:50.973271 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbkp4" Jun 06 16:47:51.027943 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.027915 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:51.033723 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.033697 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 16:47:51.047224 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cnibin\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysconfig\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047248 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cnibin\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9vg\" (UniqueName: \"kubernetes.io/projected/e3f336c0-4fa1-4d84-844d-c76e88c994b7-kube-api-access-zd9vg\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047350 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5gz\" (UniqueName: \"kubernetes.io/projected/9d8e4c6f-baed-471c-b50f-bb979cc12760-kube-api-access-dj5gz\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-ovn\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.047408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjzs8\" (UniqueName: \"kubernetes.io/projected/41092481-72ad-4ed6-ac52-65c06c04d5bb-kube-api-access-bjzs8\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-systemd\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-host\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047620 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4db59a34-eee8-46a6-badf-618c23f3f3a1-konnectivity-ca\") pod \"konnectivity-agent-9sm4t\" (UID: \"4db59a34-eee8-46a6-badf-618c23f3f3a1\") " pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb76a589-8bc2-4d18-9930-a9faaf997801-host\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb76a589-8bc2-4d18-9930-a9faaf997801-serviceca\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-iptables-alerter-script\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047791 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb76a589-8bc2-4d18-9930-a9faaf997801-host\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.047835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fca3bd8-9420-44df-813e-5579d446688b-tmp\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047843 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-device-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-log-socket\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-cni-multus\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9wjb\" (UniqueName: \"kubernetes.io/projected/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-kube-api-access-g9wjb\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.047985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-kubelet\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048016 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovnkube-config\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048055 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-cni-multus\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4db59a34-eee8-46a6-badf-618c23f3f3a1-agent-certs\") pod \"konnectivity-agent-9sm4t\" (UID: \"4db59a34-eee8-46a6-badf-618c23f3f3a1\") " pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048122 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-socket-dir-parent\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048200 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-hostroot\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048231 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-hostroot\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-kubelet-config\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-socket-dir-parent\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.048404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-slash\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb76a589-8bc2-4d18-9930-a9faaf997801-serviceca\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-iptables-alerter-script\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-etc-kubernetes\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048470 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-etc-kubernetes\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-dbus\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-env-overrides\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-daemon-config\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-system-cni-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-k8s-cni-cncf-io\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-lib-modules\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-k8s-cni-cncf-io\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-system-cni-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d45z\" (UniqueName: \"kubernetes.io/projected/891ed2bc-6e19-4be9-ab63-52872c132ef9-kube-api-access-2d45z\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-node-log\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrlkk\" (UniqueName: \"kubernetes.io/projected/85a9f767-0b05-4ebf-a348-cc02ea89adb4-kube-api-access-rrlkk\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-kubernetes\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-run\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-var-lib-kubelet\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048892 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-systemd\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.048998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-system-cni-dir\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-os-release\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-kubelet\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8nnl\" (UniqueName: \"kubernetes.io/projected/bb76a589-8bc2-4d18-9930-a9faaf997801-kube-api-access-g8nnl\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049075 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-system-cni-dir\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-sys\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59s7\" (UniqueName: \"kubernetes.io/projected/9fca3bd8-9420-44df-813e-5579d446688b-kube-api-access-t59s7\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-systemd-units\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049115 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-kubelet\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.049747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85a9f767-0b05-4ebf-a348-cc02ea89adb4-os-release\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-cni-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-daemon-config\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-cni-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6sv8\" (UniqueName: \"kubernetes.io/projected/c9bedaf8-c988-4514-b190-1cce9f971446-kube-api-access-j6sv8\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-registration-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049293 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-etc-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-modprobe-d\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049340 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysctl-d\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-socket-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-sys-fs\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-run-netns\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovn-node-metrics-cert\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-os-release\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-netns\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-cni-bin\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050279 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049507 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-conf-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-host-slash\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049535 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-var-lib-cni-bin\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-netns\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049508 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-os-release\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049552 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9fca3bd8-9420-44df-813e-5579d446688b-etc-tuned\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049583 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-host-slash\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-multus-certs\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-multus-conf-dir\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9bedaf8-c988-4514-b190-1cce9f971446-hosts-file\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049637 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-host-run-multus-certs\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9bedaf8-c988-4514-b190-1cce9f971446-tmp-dir\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysctl-conf\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049675 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9bedaf8-c988-4514-b190-1cce9f971446-hosts-file\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovnkube-script-lib\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-cnibin\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a9f767-0b05-4ebf-a348-cc02ea89adb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41092481-72ad-4ed6-ac52-65c06c04d5bb-cnibin\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.050777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41092481-72ad-4ed6-ac52-65c06c04d5bb-cni-binary-copy\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.051264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.051264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049851 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9bedaf8-c988-4514-b190-1cce9f971446-tmp-dir\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.051264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-var-lib-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.051264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-cni-bin\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.051264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.049987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-cni-netd\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.051264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.050159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41092481-72ad-4ed6-ac52-65c06c04d5bb-cni-binary-copy\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.053167 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.053149 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 16:47:51.056579 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.056557 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:51.056692 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.056585 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:51.056692 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.056598 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:51.056810 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.056705 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:51.556671137 +0000 UTC m=+2.989508647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:51.057215 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.057155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjzs8\" (UniqueName: \"kubernetes.io/projected/41092481-72ad-4ed6-ac52-65c06c04d5bb-kube-api-access-bjzs8\") pod \"multus-p7wtb\" (UID: \"41092481-72ad-4ed6-ac52-65c06c04d5bb\") " pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.058762 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.058733 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9wjb\" (UniqueName: \"kubernetes.io/projected/c35b86d5-fcae-4e88-9721-ebf5cdc82f8c-kube-api-access-g9wjb\") pod \"iptables-alerter-k5ck6\" (UID: \"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c\") " pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.059521 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.059497 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6sv8\" (UniqueName: \"kubernetes.io/projected/c9bedaf8-c988-4514-b190-1cce9f971446-kube-api-access-j6sv8\") pod \"node-resolver-96bcr\" (UID: \"c9bedaf8-c988-4514-b190-1cce9f971446\") " pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.059869 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.059847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrlkk\" (UniqueName: \"kubernetes.io/projected/85a9f767-0b05-4ebf-a348-cc02ea89adb4-kube-api-access-rrlkk\") pod \"multus-additional-cni-plugins-tgk68\" (UID: \"85a9f767-0b05-4ebf-a348-cc02ea89adb4\") " pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.060194 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.060177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8nnl\" (UniqueName: \"kubernetes.io/projected/bb76a589-8bc2-4d18-9930-a9faaf997801-kube-api-access-g8nnl\") pod \"node-ca-bshh4\" (UID: \"bb76a589-8bc2-4d18-9930-a9faaf997801\") " pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.151148 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.151148 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-kubelet-config\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-slash\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151241 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-slash\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-dbus\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-kubelet-config\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151256 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-env-overrides\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151309 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-dbus\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151329 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-lib-modules\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d45z\" (UniqueName: \"kubernetes.io/projected/891ed2bc-6e19-4be9-ab63-52872c132ef9-kube-api-access-2d45z\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-node-log\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151492 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-node-log\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.151517 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151528 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-lib-modules\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-kubernetes\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.151585 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:51.651563693 +0000 UTC m=+3.084401226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-run\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-var-lib-kubelet\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-systemd\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-run\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-sys\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59s7\" (UniqueName: \"kubernetes.io/projected/9fca3bd8-9420-44df-813e-5579d446688b-kube-api-access-t59s7\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151614 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-kubernetes\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-var-lib-kubelet\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-systemd-units\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.151890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151770 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-env-overrides\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-registration-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-etc-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151821 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-systemd\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-modprobe-d\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-sys\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysctl-d\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151860 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-etc-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151870 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-registration-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-socket-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-sys-fs\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-run-netns\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151933 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-modprobe-d\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovn-node-metrics-cert\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151951 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysctl-d\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151977 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-sys-fs\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151986 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-run-netns\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.152752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151875 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-systemd-units\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.151993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9fca3bd8-9420-44df-813e-5579d446688b-etc-tuned\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysctl-conf\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152015 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-socket-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovnkube-script-lib\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-var-lib-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-cni-bin\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152149 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-cni-netd\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysconfig\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysctl-conf\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9vg\" (UniqueName: \"kubernetes.io/projected/e3f336c0-4fa1-4d84-844d-c76e88c994b7-kube-api-access-zd9vg\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5gz\" (UniqueName: \"kubernetes.io/projected/9d8e4c6f-baed-471c-b50f-bb979cc12760-kube-api-access-dj5gz\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-ovn\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152340 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-systemd\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.153610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-host\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-cni-netd\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4db59a34-eee8-46a6-badf-618c23f3f3a1-konnectivity-ca\") pod \"konnectivity-agent-9sm4t\" (UID: \"4db59a34-eee8-46a6-badf-618c23f3f3a1\") " pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152419 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-var-lib-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fca3bd8-9420-44df-813e-5579d446688b-tmp\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.152460 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-device-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-cni-bin\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-log-socket\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.152523 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:47:51.652505845 +0000 UTC m=+3.085343355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-sysconfig\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-kubelet\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovnkube-config\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4db59a34-eee8-46a6-badf-618c23f3f3a1-agent-certs\") pod \"konnectivity-agent-9sm4t\" (UID: \"4db59a34-eee8-46a6-badf-618c23f3f3a1\") " pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-host\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.154537 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152654 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovnkube-script-lib\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152656 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-openvswitch\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152539 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-log-socket\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9fca3bd8-9420-44df-813e-5579d446688b-etc-systemd\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-run-ovn\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-device-dir\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152806 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/891ed2bc-6e19-4be9-ab63-52872c132ef9-host-kubelet\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.152997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d8e4c6f-baed-471c-b50f-bb979cc12760-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.153380 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4db59a34-eee8-46a6-badf-618c23f3f3a1-konnectivity-ca\") pod \"konnectivity-agent-9sm4t\" (UID: \"4db59a34-eee8-46a6-badf-618c23f3f3a1\") " pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.153675 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovnkube-config\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.155277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9fca3bd8-9420-44df-813e-5579d446688b-etc-tuned\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.155278 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4db59a34-eee8-46a6-badf-618c23f3f3a1-agent-certs\") pod \"konnectivity-agent-9sm4t\" (UID: \"4db59a34-eee8-46a6-badf-618c23f3f3a1\") " pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.155357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.155306 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fca3bd8-9420-44df-813e-5579d446688b-tmp\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.155995 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.155975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/891ed2bc-6e19-4be9-ab63-52872c132ef9-ovn-node-metrics-cert\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.160103 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.160051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59s7\" (UniqueName: \"kubernetes.io/projected/9fca3bd8-9420-44df-813e-5579d446688b-kube-api-access-t59s7\") pod \"tuned-zjr2h\" (UID: \"9fca3bd8-9420-44df-813e-5579d446688b\") " pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.160503 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.160421 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d45z\" (UniqueName: \"kubernetes.io/projected/891ed2bc-6e19-4be9-ab63-52872c132ef9-kube-api-access-2d45z\") pod \"ovnkube-node-mc8c2\" (UID: \"891ed2bc-6e19-4be9-ab63-52872c132ef9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.160503 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.160452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5gz\" (UniqueName: \"kubernetes.io/projected/9d8e4c6f-baed-471c-b50f-bb979cc12760-kube-api-access-dj5gz\") pod \"aws-ebs-csi-driver-node-g6wng\" (UID: \"9d8e4c6f-baed-471c-b50f-bb979cc12760\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.161476 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.161423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9vg\" (UniqueName: \"kubernetes.io/projected/e3f336c0-4fa1-4d84-844d-c76e88c994b7-kube-api-access-zd9vg\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:51.238603 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.238510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgk68" Jun 06 16:47:51.247691 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.247660 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7wtb" Jun 06 16:47:51.253039 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.253019 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:51.258272 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.258248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-96bcr" Jun 06 16:47:51.261993 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.261970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bshh4" Jun 06 16:47:51.269852 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.269829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k5ck6" Jun 06 16:47:51.276059 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.276040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:47:51.282030 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.282012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:47:51.288319 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.288303 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" Jun 06 16:47:51.292909 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.292887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" Jun 06 16:47:51.656490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.656391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:51.656490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.656469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.656504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656567 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656613 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656627 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656644 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656658 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:51.656687 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656645 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:47:52.656620174 +0000 UTC m=+4.089457684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:51.657022 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656714 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:52.656697411 +0000 UTC m=+4.089534926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:51.657022 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:51.656738 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:52.656728135 +0000 UTC m=+4.089565651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:51.762740 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.762716 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9bedaf8_c988_4514_b190_1cce9f971446.slice/crio-ee3d545bbf56f083b2cab99f5da83aca799e0f400beb967d679cad9d630a650f WatchSource:0}: Error finding container ee3d545bbf56f083b2cab99f5da83aca799e0f400beb967d679cad9d630a650f: Status 404 returned error can't find the container with id ee3d545bbf56f083b2cab99f5da83aca799e0f400beb967d679cad9d630a650f Jun 06 16:47:51.764205 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.764177 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db59a34_eee8_46a6_badf_618c23f3f3a1.slice/crio-44ca6e38582d527eb3afbcb45ce874568747a635dc873ce7787a120ea85489d3 WatchSource:0}: Error finding container 44ca6e38582d527eb3afbcb45ce874568747a635dc873ce7787a120ea85489d3: Status 404 returned error can't find the container with id 44ca6e38582d527eb3afbcb45ce874568747a635dc873ce7787a120ea85489d3 Jun 06 16:47:51.764984 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.764964 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a9f767_0b05_4ebf_a348_cc02ea89adb4.slice/crio-5043e5b8a2db4da8d6b7dd2544bccabbaa32aa7bba469a6ba7943b2016de107d WatchSource:0}: Error finding container 5043e5b8a2db4da8d6b7dd2544bccabbaa32aa7bba469a6ba7943b2016de107d: Status 404 returned error can't find the container with id 5043e5b8a2db4da8d6b7dd2544bccabbaa32aa7bba469a6ba7943b2016de107d Jun 06 16:47:51.766661 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.766620 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41092481_72ad_4ed6_ac52_65c06c04d5bb.slice/crio-8eb61098b4bd9d848f1cf4c7295cbf04d02f6b368b224fe6b4671ad4f1044897 WatchSource:0}: Error finding container 8eb61098b4bd9d848f1cf4c7295cbf04d02f6b368b224fe6b4671ad4f1044897: Status 404 returned error can't find the container with id 8eb61098b4bd9d848f1cf4c7295cbf04d02f6b368b224fe6b4671ad4f1044897 Jun 06 16:47:51.768487 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.768407 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb76a589_8bc2_4d18_9930_a9faaf997801.slice/crio-2fa797c16fc780bf17c844fe77bc637a4182cea684ad065fcec20d200f96a25c WatchSource:0}: Error finding container 2fa797c16fc780bf17c844fe77bc637a4182cea684ad065fcec20d200f96a25c: Status 404 returned error can't find the container with id 2fa797c16fc780bf17c844fe77bc637a4182cea684ad065fcec20d200f96a25c Jun 06 16:47:51.769197 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.769096 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35b86d5_fcae_4e88_9721_ebf5cdc82f8c.slice/crio-602ff6343a5ada5aa4b313d6ee90adeb10dc4557940e083ace436b936b2e34a9 WatchSource:0}: Error finding container 602ff6343a5ada5aa4b313d6ee90adeb10dc4557940e083ace436b936b2e34a9: Status 404 returned error can't find the container with id 602ff6343a5ada5aa4b313d6ee90adeb10dc4557940e083ace436b936b2e34a9 Jun 06 16:47:51.769920 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.769900 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8e4c6f_baed_471c_b50f_bb979cc12760.slice/crio-9a32f344264cd315b49943ae930a3fa95b2dafeaee704516a24b655a8f873a4c WatchSource:0}: Error finding container 9a32f344264cd315b49943ae930a3fa95b2dafeaee704516a24b655a8f873a4c: Status 404 returned error can't find the container with id 9a32f344264cd315b49943ae930a3fa95b2dafeaee704516a24b655a8f873a4c Jun 06 16:47:51.771781 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.771760 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891ed2bc_6e19_4be9_ab63_52872c132ef9.slice/crio-fddc31411354ffccb6105edfbd8fe2fbd420777e33c6294c69b7cca137742a98 WatchSource:0}: Error finding container fddc31411354ffccb6105edfbd8fe2fbd420777e33c6294c69b7cca137742a98: Status 404 returned error can't find the container with id fddc31411354ffccb6105edfbd8fe2fbd420777e33c6294c69b7cca137742a98 Jun 06 16:47:51.773475 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:47:51.773169 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fca3bd8_9420_44df_813e_5579d446688b.slice/crio-bf4ed304e9625813fa47115bf08b50681bc02eaa06cda8f3112268ab3c70b20f WatchSource:0}: Error finding container bf4ed304e9625813fa47115bf08b50681bc02eaa06cda8f3112268ab3c70b20f: Status 404 returned error can't find the container with id bf4ed304e9625813fa47115bf08b50681bc02eaa06cda8f3112268ab3c70b20f Jun 06 16:47:51.977281 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.977027 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 16:42:50 +0000 UTC" deadline="2028-02-15 01:53:08.011059148 +0000 UTC" Jun 06 16:47:51.977281 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:51.977233 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14841h5m16.033834215s" Jun 06 16:47:52.013244 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.013197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" event={"ID":"9fca3bd8-9420-44df-813e-5579d446688b","Type":"ContainerStarted","Data":"bf4ed304e9625813fa47115bf08b50681bc02eaa06cda8f3112268ab3c70b20f"} Jun 06 16:47:52.014426 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.014395 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" event={"ID":"9d8e4c6f-baed-471c-b50f-bb979cc12760","Type":"ContainerStarted","Data":"9a32f344264cd315b49943ae930a3fa95b2dafeaee704516a24b655a8f873a4c"} Jun 06 16:47:52.015456 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.015421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7wtb" event={"ID":"41092481-72ad-4ed6-ac52-65c06c04d5bb","Type":"ContainerStarted","Data":"8eb61098b4bd9d848f1cf4c7295cbf04d02f6b368b224fe6b4671ad4f1044897"} Jun 06 16:47:52.016487 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.016461 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerStarted","Data":"5043e5b8a2db4da8d6b7dd2544bccabbaa32aa7bba469a6ba7943b2016de107d"} Jun 06 16:47:52.017846 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.017818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-96bcr" event={"ID":"c9bedaf8-c988-4514-b190-1cce9f971446","Type":"ContainerStarted","Data":"ee3d545bbf56f083b2cab99f5da83aca799e0f400beb967d679cad9d630a650f"} Jun 06 16:47:52.021311 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.021281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" event={"ID":"0b77a3d35a85da5c6ed251539a21fda5","Type":"ContainerStarted","Data":"ad650e2a74217b02c429acecb2db922c133d88e121b81eda80bf7534b151ba1c"} Jun 06 16:47:52.025299 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.025278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k5ck6" event={"ID":"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c","Type":"ContainerStarted","Data":"602ff6343a5ada5aa4b313d6ee90adeb10dc4557940e083ace436b936b2e34a9"} Jun 06 16:47:52.027262 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.027243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"fddc31411354ffccb6105edfbd8fe2fbd420777e33c6294c69b7cca137742a98"} Jun 06 16:47:52.028295 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.028271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bshh4" event={"ID":"bb76a589-8bc2-4d18-9930-a9faaf997801","Type":"ContainerStarted","Data":"2fa797c16fc780bf17c844fe77bc637a4182cea684ad065fcec20d200f96a25c"} Jun 06 16:47:52.029556 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.029538 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9sm4t" event={"ID":"4db59a34-eee8-46a6-badf-618c23f3f3a1","Type":"ContainerStarted","Data":"44ca6e38582d527eb3afbcb45ce874568747a635dc873ce7787a120ea85489d3"} Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.664200 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.664274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.664322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.664469 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.664486 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.664499 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.664559 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:54.664539922 +0000 UTC m=+6.097377436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.664953 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.665001 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:54.664985198 +0000 UTC m=+6.097822711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.665054 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:52.665126 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:52.665087 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:47:54.665076371 +0000 UTC m=+6.097913884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:52.711029 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.710749 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 16:47:52.977822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.977680 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 16:42:50 +0000 UTC" deadline="2027-11-06 17:56:24.79221051 +0000 UTC" Jun 06 16:47:52.977822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:52.977740 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12433h8m31.814474492s" Jun 06 16:47:53.006106 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:53.006076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:53.006266 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:53.006218 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:47:53.006663 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:53.006624 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:53.006763 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:53.006719 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:47:53.006825 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:53.006779 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:53.006876 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:53.006842 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:47:53.050799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:53.049512 2572 generic.go:356] "Generic (PLEG): container finished" podID="af46534d1c16173c477c4be6e514c2c6" containerID="7b2bf0660be15c5bff130769104c4798cc8c95e2425d18485065420c6ad27912" exitCode=0 Jun 06 16:47:53.050799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:53.050533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" event={"ID":"af46534d1c16173c477c4be6e514c2c6","Type":"ContainerDied","Data":"7b2bf0660be15c5bff130769104c4798cc8c95e2425d18485065420c6ad27912"} Jun 06 16:47:53.065776 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:53.065516 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-67.ec2.internal" podStartSLOduration=3.065495652 podStartE2EDuration="3.065495652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:52.034263766 +0000 UTC m=+3.467101299" watchObservedRunningTime="2026-06-06 16:47:53.065495652 +0000 UTC m=+4.498333184" Jun 06 16:47:54.078002 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:54.077966 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" event={"ID":"af46534d1c16173c477c4be6e514c2c6","Type":"ContainerStarted","Data":"abb3c48f341b891f664bce7ac0778f728f721310e97d1b6eb9d7979f587a97e8"} Jun 06 16:47:54.682538 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:54.682503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:54.682692 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:54.682557 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:54.682692 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:54.682612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:54.682764 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.682736 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:54.682809 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.682797 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:47:58.682779267 +0000 UTC m=+10.115616782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:54.683234 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.683216 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:54.683300 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.683246 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:54.683300 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.683260 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:54.683363 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.683305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:58.6832905 +0000 UTC m=+10.116128015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:54.683419 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.683362 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:54.683419 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:54.683393 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:47:58.683382815 +0000 UTC m=+10.116220329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:55.004890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:55.004772 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:55.005066 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:55.004902 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:47:55.005066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:55.004955 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:55.005066 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:55.005018 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:47:55.007175 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:55.007147 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:55.007360 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:55.007336 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:47:57.004627 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:57.004593 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:57.004627 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:57.004614 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:57.005141 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:57.004593 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:57.005141 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:57.004722 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:47:57.005141 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:57.004798 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:47:57.005141 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:57.004905 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:47:58.717013 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:58.716974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:58.717472 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:58.717052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:58.717472 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:58.717084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:58.717472 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717224 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:58.717472 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717289 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:06.717266864 +0000 UTC m=+18.150104393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:47:58.717472 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717337 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:58.717472 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717400 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:48:06.717381609 +0000 UTC m=+18.150219124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:47:58.717793 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717498 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:47:58.717793 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717518 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:47:58.717793 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717530 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:58.717793 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:58.717609 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:06.717553542 +0000 UTC m=+18.150391056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:47:59.006337 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:59.005270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:47:59.006337 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:59.005407 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:47:59.006337 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:59.005639 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:47:59.006771 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:59.006742 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:47:59.006771 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:47:59.006764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:47:59.006883 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:47:59.006862 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:01.005008 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:01.004969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:01.005008 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:01.005001 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:01.005547 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:01.004969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:01.005547 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:01.005121 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:01.005547 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:01.005215 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:01.005547 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:01.005332 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:03.004083 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:03.004045 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:03.004083 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:03.004086 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:03.004649 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:03.004046 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:03.004649 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:03.004181 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:03.004649 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:03.004270 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:03.004649 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:03.004320 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:05.005114 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:05.005073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:05.005587 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:05.005073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:05.005587 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:05.005225 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:05.005587 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:05.005221 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:05.005587 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:05.005343 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:05.005587 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:05.005450 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:06.781327 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:06.781257 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:06.781327 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:06.781312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:06.781367 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781474 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781500 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781501 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781513 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781502 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781568 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:22.7815504 +0000 UTC m=+34.214387926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781588 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:48:22.781579442 +0000 UTC m=+34.214416955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:48:06.781890 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:06.781601 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:22.781594333 +0000 UTC m=+34.214431843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:48:07.004625 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:07.004594 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:07.004625 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:07.004636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:07.004838 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:07.004602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:07.004838 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:07.004724 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:07.004838 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:07.004801 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:07.004989 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:07.004881 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:09.007500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:09.007468 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:09.008037 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:09.007507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:09.008037 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:09.007579 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:09.008037 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:09.007589 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:09.008037 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:09.007669 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:09.008037 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:09.007796 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:11.005126 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.004944 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:11.005490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.004943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:11.005490 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:11.005232 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:11.005490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.004944 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:11.005490 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:11.005272 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:11.005490 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:11.005379 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:11.129870 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.129830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bshh4" event={"ID":"bb76a589-8bc2-4d18-9930-a9faaf997801","Type":"ContainerStarted","Data":"b481ad60c9542ff4943b7c69aa5bca2d8cf4c7bf0689e910e094b7d870b4c2f3"} Jun 06 16:48:11.132574 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.132285 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9sm4t" event={"ID":"4db59a34-eee8-46a6-badf-618c23f3f3a1","Type":"ContainerStarted","Data":"acdb94ec0631581cff9adaec953640a4b2980264baa909e3934a70fb9bd3a78c"} Jun 06 16:48:11.136047 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.135631 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" event={"ID":"9fca3bd8-9420-44df-813e-5579d446688b","Type":"ContainerStarted","Data":"a2e9ade8434f0550563333b97c9483f04300a6c1284a1dcb2e8ec0f9d4acd1af"} Jun 06 16:48:11.137748 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.137722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" event={"ID":"9d8e4c6f-baed-471c-b50f-bb979cc12760","Type":"ContainerStarted","Data":"2ae1d6a506492b9b545569cc3ba511e3fbbb3f261040831c12f6effdfb402bd6"} Jun 06 16:48:11.140250 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.140016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7wtb" event={"ID":"41092481-72ad-4ed6-ac52-65c06c04d5bb","Type":"ContainerStarted","Data":"03ed57886bea9fa0dadcb6870365d59b31db8434d8635f882f4fb598d125dfb2"} Jun 06 16:48:11.148181 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.144377 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bshh4" podStartSLOduration=3.408603814 podStartE2EDuration="22.144358966s" totalImagesPullingTime="18.735755152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:11.143216872 +0000 UTC m=+22.576054405" watchObservedRunningTime="2026-06-06 16:48:11.144358966 +0000 UTC m=+22.577196492" Jun 06 16:48:11.148181 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.144511 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-67.ec2.internal" podStartSLOduration=21.144500029 podStartE2EDuration="21.144500029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:47:54.093071465 +0000 UTC m=+5.525908999" watchObservedRunningTime="2026-06-06 16:48:11.144500029 +0000 UTC m=+22.577337564" Jun 06 16:48:11.148504 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.148223 2572 generic.go:356] "Generic (PLEG): container finished" podID="85a9f767-0b05-4ebf-a348-cc02ea89adb4" containerID="4ee427df5ccd65e070eef0215c006dc4398c50db5412208091538cbc6fb57b34" exitCode=0 Jun 06 16:48:11.148504 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.148311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerDied","Data":"4ee427df5ccd65e070eef0215c006dc4398c50db5412208091538cbc6fb57b34"} Jun 06 16:48:11.151368 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.151341 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-96bcr" event={"ID":"c9bedaf8-c988-4514-b190-1cce9f971446","Type":"ContainerStarted","Data":"b327d25fceca6e563d285b469bd869c3f2a377267aa3fcc78d9228c9df0624a3"} Jun 06 16:48:11.157646 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.157624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:48:11.158799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.158037 2572 generic.go:356] "Generic (PLEG): container finished" podID="891ed2bc-6e19-4be9-ab63-52872c132ef9" containerID="747523b4b14ce48cdd5715bfaca112c1f4c7267c2213722e3521bdc2c81e2dfa" exitCode=1 Jun 06 16:48:11.158799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.158077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"178d243d9d52f20ec1931f89a4b2429af670ebe945867a3e3ffd18dc82040954"} Jun 06 16:48:11.158799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.158144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"f6c15a00f6a305ddad22e8990d1d1933aa172ab14ac24a27cfc7501213a2860f"} Jun 06 16:48:11.158799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.158190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerDied","Data":"747523b4b14ce48cdd5715bfaca112c1f4c7267c2213722e3521bdc2c81e2dfa"} Jun 06 16:48:11.158799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.158256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"7da1cb6a76f58c5e5b9084add73d0ac0a150536c26d3829dfd134cf92ca910fe"} Jun 06 16:48:11.161137 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.161094 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p7wtb" podStartSLOduration=3.373425692 podStartE2EDuration="22.161081821s" totalImagesPullingTime="18.787656129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:11.160479867 +0000 UTC m=+22.593317400" watchObservedRunningTime="2026-06-06 16:48:11.161081821 +0000 UTC m=+22.593919354" Jun 06 16:48:11.174557 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.174512 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9sm4t" podStartSLOduration=3.9075748409999997 podStartE2EDuration="22.174493397s" totalImagesPullingTime="18.266918556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:11.17392706 +0000 UTC m=+22.606764593" watchObservedRunningTime="2026-06-06 16:48:11.174493397 +0000 UTC m=+22.607330965" Jun 06 16:48:11.191085 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:11.191037 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zjr2h" podStartSLOduration=3.438198895 podStartE2EDuration="22.191021026s" totalImagesPullingTime="18.752822131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:11.190911663 +0000 UTC m=+22.623749195" watchObservedRunningTime="2026-06-06 16:48:11.191021026 +0000 UTC m=+22.623858558" Jun 06 16:48:12.006510 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.006471 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 16:48:12.164249 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.164168 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:48:12.164610 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.164586 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"f50c06d3cb4a4e603fbdc5d14f4f6565ca38d661fe07528549ef30a61a6ba38c"} Jun 06 16:48:12.164721 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.164707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"b10d218e0a1d89507f186772e615fced2dddd917fb8f00a214431e23ffa318a9"} Jun 06 16:48:12.166490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.166466 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" event={"ID":"9d8e4c6f-baed-471c-b50f-bb979cc12760","Type":"ContainerStarted","Data":"c1c60f7bfaeec3698141d0d4e850ed27e25c6f3611344dac7f216da51bd47739"} Jun 06 16:48:12.167912 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.167889 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k5ck6" event={"ID":"c35b86d5-fcae-4e88-9721-ebf5cdc82f8c","Type":"ContainerStarted","Data":"6546b41583988358673ec26ef4812bfa0438637460d2dde7b8e40f10ed7934d9"} Jun 06 16:48:12.183460 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:12.183390 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-96bcr" podStartSLOduration=4.471681474 podStartE2EDuration="23.183368937s" totalImagesPullingTime="18.711687463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:11.226660561 +0000 UTC m=+22.659498094" watchObservedRunningTime="2026-06-06 16:48:12.183368937 +0000 UTC m=+23.616206470" Jun 06 16:48:13.002317 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.001986 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T16:48:12.006505611Z","UUID":"8e21ba0d-542b-4f52-93aa-29698d5e4c5d","Handler":null,"Name":"","Endpoint":""} Jun 06 16:48:13.003857 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.003838 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 16:48:13.003978 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.003882 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 16:48:13.004293 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.004267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:13.004481 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.004320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:13.004481 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.004267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:13.004481 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:13.004464 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:13.004638 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:13.004502 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:13.004638 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:13.004563 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:13.172224 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.172181 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" event={"ID":"9d8e4c6f-baed-471c-b50f-bb979cc12760","Type":"ContainerStarted","Data":"7f135d605aadb916edcc9fc3dbb38f7ce9e36a724ca41a030599b5712fc5133b"} Jun 06 16:48:13.189146 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.189041 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k5ck6" podStartSLOduration=5.432365723 podStartE2EDuration="24.189018117s" totalImagesPullingTime="18.756652394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:12.182869628 +0000 UTC m=+23.615707164" watchObservedRunningTime="2026-06-06 16:48:13.189018117 +0000 UTC m=+24.621855651" Jun 06 16:48:13.189312 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:13.189276 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6wng" podStartSLOduration=3.443446935 podStartE2EDuration="24.189265943s" totalImagesPullingTime="20.745819008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:13.188313615 +0000 UTC m=+24.621151144" watchObservedRunningTime="2026-06-06 16:48:13.189265943 +0000 UTC m=+24.622103474" Jun 06 16:48:14.178094 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:14.178064 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:48:14.178593 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:14.178498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"676f1797b60816c5b0c454ae5073c0d45a3000b474c692df1c0e27a3d1416001"} Jun 06 16:48:14.563661 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:14.563626 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:48:14.564385 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:14.564362 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:48:15.004364 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:15.004326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:15.004623 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:15.004326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:15.004623 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:15.004466 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:15.004623 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:15.004498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:15.004623 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:15.004602 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:15.004822 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:15.004676 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:15.093061 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:15.093023 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:48:15.093723 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:15.093701 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9sm4t" Jun 06 16:48:16.185099 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:16.184922 2572 generic.go:356] "Generic (PLEG): container finished" podID="85a9f767-0b05-4ebf-a348-cc02ea89adb4" containerID="d99181b1a2308af523b98d02efb6936e294b962d579c32a79d9e46b9b87da0b0" exitCode=0 Jun 06 16:48:16.185505 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:16.185008 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerDied","Data":"d99181b1a2308af523b98d02efb6936e294b962d579c32a79d9e46b9b87da0b0"} Jun 06 16:48:16.188880 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:16.188862 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:48:16.189231 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:16.189214 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"726c345346fd553d7884e36ee75f28931fc0c56be70ebffd17616efcf7dc476d"} Jun 06 16:48:16.189614 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:16.189601 2572 scope.go:117] "RemoveContainer" containerID="747523b4b14ce48cdd5715bfaca112c1f4c7267c2213722e3521bdc2c81e2dfa" Jun 06 16:48:17.004407 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.004379 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:17.004407 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.004377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:17.004626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.004377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:17.004626 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:17.004502 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:17.004729 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:17.004678 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:17.004765 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:17.004726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:17.196270 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.196239 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:48:17.197109 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.196848 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" event={"ID":"891ed2bc-6e19-4be9-ab63-52872c132ef9","Type":"ContainerStarted","Data":"d1568b07beaba9683598fcfd12ec57bb7977acecbd791fc41c8912d831185d3b"} Jun 06 16:48:17.197109 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.196906 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 06 16:48:17.197345 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.197325 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:48:17.197417 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.197403 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:48:17.200246 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.200216 2572 generic.go:356] "Generic (PLEG): container finished" podID="85a9f767-0b05-4ebf-a348-cc02ea89adb4" containerID="ad990ce8cd46a4c62a8c5186daec52def79ee38a6041df7634f8f725aa62112d" exitCode=0 Jun 06 16:48:17.200378 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.200256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerDied","Data":"ad990ce8cd46a4c62a8c5186daec52def79ee38a6041df7634f8f725aa62112d"} Jun 06 16:48:17.216725 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.216695 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:48:17.217603 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.217579 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:48:17.224385 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.224337 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" podStartSLOduration=9.399514596 podStartE2EDuration="28.224321803s" totalImagesPullingTime="18.824807207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:17.22258557 +0000 UTC m=+28.655423104" watchObservedRunningTime="2026-06-06 16:48:17.224321803 +0000 UTC m=+28.657159335" Jun 06 16:48:17.468708 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.468626 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kxtn"] Jun 06 16:48:17.468855 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.468787 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:17.468918 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:17.468895 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:17.471450 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.471383 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shnng"] Jun 06 16:48:17.471565 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.471511 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:17.471651 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:17.471625 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:17.471968 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.471944 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-642vt"] Jun 06 16:48:17.472065 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:17.472039 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:17.472141 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:17.472124 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:18.203236 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:18.203148 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:48:18.205206 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:18.205183 2572 generic.go:356] "Generic (PLEG): container finished" podID="85a9f767-0b05-4ebf-a348-cc02ea89adb4" containerID="8facebac9acb8ed1bfcfa43e63a78792e3e4ef8940c9677fd4e758825b4d9218" exitCode=0 Jun 06 16:48:18.205306 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:18.205270 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerDied","Data":"8facebac9acb8ed1bfcfa43e63a78792e3e4ef8940c9677fd4e758825b4d9218"} Jun 06 16:48:19.006265 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:19.006195 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:19.006475 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:19.006338 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:19.006475 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:19.006389 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:19.006475 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:19.006466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:19.006647 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:19.006458 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:19.006647 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:19.006540 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:21.004993 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:21.004958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:21.005457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:21.004958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:21.005457 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:21.005104 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:21.005457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:21.004958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:21.005457 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:21.005196 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:21.005457 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:21.005240 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:22.804567 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:22.804499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:22.804567 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:22.804552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:22.804593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804641 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804698 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:54.804683807 +0000 UTC m=+66.237521317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804700 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804715 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804734 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804746 2572 projected.go:196] Error preparing data for projected volume kube-api-access-s4lhg for pod openshift-network-diagnostics/network-check-target-9kxtn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804751 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret podName:0c5c6797-1b7e-4094-9dbe-454cde02bf5c nodeName:}" failed. No retries permitted until 2026-06-06 16:48:54.804732267 +0000 UTC m=+66.237569776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret") pod "global-pull-secret-syncer-642vt" (UID: "0c5c6797-1b7e-4094-9dbe-454cde02bf5c") : object "kube-system"/"original-pull-secret" not registered Jun 06 16:48:22.804980 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:22.804788 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg podName:93f0d819-ab76-4717-87a4-55016d4d91a8 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:54.804775559 +0000 UTC m=+66.237613075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lhg" (UniqueName: "kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg") pod "network-check-target-9kxtn" (UID: "93f0d819-ab76-4717-87a4-55016d4d91a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 16:48:23.004036 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.004005 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:23.004404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.004013 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:23.004404 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:23.004106 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kxtn" podUID="93f0d819-ab76-4717-87a4-55016d4d91a8" Jun 06 16:48:23.004404 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.004122 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:23.004404 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:23.004206 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:48:23.004404 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:23.004277 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-642vt" podUID="0c5c6797-1b7e-4094-9dbe-454cde02bf5c" Jun 06 16:48:23.223035 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.222922 2572 generic.go:356] "Generic (PLEG): container finished" podID="85a9f767-0b05-4ebf-a348-cc02ea89adb4" containerID="85dc5e1ec55f9356dc5c56ede200b44898c20a1159983c7b8e397c5591e87933" exitCode=0 Jun 06 16:48:23.223035 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.222977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerDied","Data":"85dc5e1ec55f9356dc5c56ede200b44898c20a1159983c7b8e397c5591e87933"} Jun 06 16:48:23.405596 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.405573 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-67.ec2.internal" event="NodeReady" Jun 06 16:48:23.405752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.405740 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 16:48:23.447367 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.447339 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bmh7j"] Jun 06 16:48:23.460056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.460025 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7vqmt"] Jun 06 16:48:23.460189 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.460148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.462892 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.462870 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 16:48:23.463236 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.463214 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6gpx\"" Jun 06 16:48:23.463397 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.463370 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 16:48:23.472540 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.472514 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmh7j"] Jun 06 16:48:23.472664 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.472608 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.472664 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.472624 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7vqmt"] Jun 06 16:48:23.475319 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.475277 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 16:48:23.475390 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.475351 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 16:48:23.475390 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.475364 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhvrz\"" Jun 06 16:48:23.475570 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.475456 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 16:48:23.609793 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.609757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7289393-072f-4fa7-98ea-dcb6eb7c9614-config-volume\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.609793 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.609793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpplw\" (UniqueName: \"kubernetes.io/projected/854d87df-39cd-4497-9d16-f4939fff2982-kube-api-access-dpplw\") pod \"ingress-canary-7vqmt\" (UID: \"854d87df-39cd-4497-9d16-f4939fff2982\") " pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.610059 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.609820 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbg8t\" (UniqueName: \"kubernetes.io/projected/f7289393-072f-4fa7-98ea-dcb6eb7c9614-kube-api-access-rbg8t\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.610059 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.609902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7289393-072f-4fa7-98ea-dcb6eb7c9614-tmp-dir\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.610059 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.609983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.610059 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.610014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/854d87df-39cd-4497-9d16-f4939fff2982-cert\") pod \"ingress-canary-7vqmt\" (UID: \"854d87df-39cd-4497-9d16-f4939fff2982\") " pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.711174 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.711343 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/854d87df-39cd-4497-9d16-f4939fff2982-cert\") pod \"ingress-canary-7vqmt\" (UID: \"854d87df-39cd-4497-9d16-f4939fff2982\") " pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.711343 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:23.711146 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:23.711343 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7289393-072f-4fa7-98ea-dcb6eb7c9614-config-volume\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.711343 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpplw\" (UniqueName: \"kubernetes.io/projected/854d87df-39cd-4497-9d16-f4939fff2982-kube-api-access-dpplw\") pod \"ingress-canary-7vqmt\" (UID: \"854d87df-39cd-4497-9d16-f4939fff2982\") " pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.711343 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:23.711290 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:24.211274445 +0000 UTC m=+35.644111955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:23.711343 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbg8t\" (UniqueName: \"kubernetes.io/projected/f7289393-072f-4fa7-98ea-dcb6eb7c9614-kube-api-access-rbg8t\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.711615 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711379 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7289393-072f-4fa7-98ea-dcb6eb7c9614-tmp-dir\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.711763 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7289393-072f-4fa7-98ea-dcb6eb7c9614-tmp-dir\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.711926 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.711911 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7289393-072f-4fa7-98ea-dcb6eb7c9614-config-volume\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.715842 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.715822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/854d87df-39cd-4497-9d16-f4939fff2982-cert\") pod \"ingress-canary-7vqmt\" (UID: \"854d87df-39cd-4497-9d16-f4939fff2982\") " pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.721986 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.721873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbg8t\" (UniqueName: \"kubernetes.io/projected/f7289393-072f-4fa7-98ea-dcb6eb7c9614-kube-api-access-rbg8t\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:23.722093 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.721933 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpplw\" (UniqueName: \"kubernetes.io/projected/854d87df-39cd-4497-9d16-f4939fff2982-kube-api-access-dpplw\") pod \"ingress-canary-7vqmt\" (UID: \"854d87df-39cd-4497-9d16-f4939fff2982\") " pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.787073 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.787038 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7vqmt" Jun 06 16:48:23.955101 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:23.955070 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7vqmt"] Jun 06 16:48:23.959096 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:48:23.959068 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854d87df_39cd_4497_9d16_f4939fff2982.slice/crio-f66aa06e34f8eddba98c2c14b3bcb38bb6216d6d392e5a52954cefa4a39bd009 WatchSource:0}: Error finding container f66aa06e34f8eddba98c2c14b3bcb38bb6216d6d392e5a52954cefa4a39bd009: Status 404 returned error can't find the container with id f66aa06e34f8eddba98c2c14b3bcb38bb6216d6d392e5a52954cefa4a39bd009 Jun 06 16:48:24.216081 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:24.215991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:24.216283 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:24.216119 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:24.216283 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:24.216171 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:25.216157668 +0000 UTC m=+36.648995178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:24.228613 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:24.228582 2572 generic.go:356] "Generic (PLEG): container finished" podID="85a9f767-0b05-4ebf-a348-cc02ea89adb4" containerID="a64be607db38664731e2c48e39e1f33b067fcdedf7e05f23163276bfb5d224b1" exitCode=0 Jun 06 16:48:24.228747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:24.228663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerDied","Data":"a64be607db38664731e2c48e39e1f33b067fcdedf7e05f23163276bfb5d224b1"} Jun 06 16:48:24.229744 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:24.229718 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7vqmt" event={"ID":"854d87df-39cd-4497-9d16-f4939fff2982","Type":"ContainerStarted","Data":"f66aa06e34f8eddba98c2c14b3bcb38bb6216d6d392e5a52954cefa4a39bd009"} Jun 06 16:48:25.004780 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.004742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:25.005587 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.004741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:25.005587 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.004748 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:25.007635 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.007614 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 16:48:25.007803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.007786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjp89\"" Jun 06 16:48:25.007882 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.007866 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 16:48:25.009003 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.008982 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbbrh\"" Jun 06 16:48:25.009104 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.009018 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 16:48:25.009104 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.009018 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 16:48:25.223718 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.223680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:25.223903 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:25.223824 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:25.223903 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:25.223893 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:27.223873398 +0000 UTC m=+38.656710920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:25.236538 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.236500 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgk68" event={"ID":"85a9f767-0b05-4ebf-a348-cc02ea89adb4","Type":"ContainerStarted","Data":"090f11c357663089ca89e2a6ac8ef42179d5b622d4662eb0c32afacb0c9355b7"} Jun 06 16:48:25.257400 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:25.257285 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tgk68" podStartSLOduration=7.500689238 podStartE2EDuration="36.25726603s" totalImagesPullingTime="28.756576792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:25.255364102 +0000 UTC m=+36.688201634" watchObservedRunningTime="2026-06-06 16:48:25.25726603 +0000 UTC m=+36.690103561" Jun 06 16:48:26.240876 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:26.240616 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7vqmt" event={"ID":"854d87df-39cd-4497-9d16-f4939fff2982","Type":"ContainerStarted","Data":"62627e4ebfa58f2078084cb142b1253c1e845167f6dac1272eb8ffc06a743eb7"} Jun 06 16:48:27.238356 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:27.237879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:27.238356 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:27.238095 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:27.238356 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:27.238152 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:31.238135441 +0000 UTC m=+42.670972952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:31.266297 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:31.266263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:31.266694 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:31.266416 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:31.266694 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:31.266496 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:39.266476913 +0000 UTC m=+50.699314434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:39.326348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:39.326306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:39.326832 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:39.326447 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:39.326832 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:39.326501 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:48:55.32648719 +0000 UTC m=+66.759324700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:49.218991 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:49.218957 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mc8c2" Jun 06 16:48:49.246671 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:49.246620 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7vqmt" podStartSLOduration=24.186108375 podStartE2EDuration="26.246603759s" totalImagesPullingTime="2.060495384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:48:26.254795867 +0000 UTC m=+37.687633399" watchObservedRunningTime="2026-06-06 16:48:49.246603759 +0000 UTC m=+60.679441291" Jun 06 16:48:54.835182 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.835141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:54.835182 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.835197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:54.835686 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.835217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:48:54.838585 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.838564 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 16:48:54.838697 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.838602 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 16:48:54.838697 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.838636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 16:48:54.845715 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:54.845696 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 16:48:54.845789 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:54.845758 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:49:58.845740567 +0000 UTC m=+130.278578077 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : secret "metrics-daemon-secret" not found Jun 06 16:48:54.848000 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.847982 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 16:48:54.848937 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.848919 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c5c6797-1b7e-4094-9dbe-454cde02bf5c-original-pull-secret\") pod \"global-pull-secret-syncer-642vt\" (UID: \"0c5c6797-1b7e-4094-9dbe-454cde02bf5c\") " pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:54.858120 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:54.858102 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lhg\" (UniqueName: \"kubernetes.io/projected/93f0d819-ab76-4717-87a4-55016d4d91a8-kube-api-access-s4lhg\") pod \"network-check-target-9kxtn\" (UID: \"93f0d819-ab76-4717-87a4-55016d4d91a8\") " pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:55.022366 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.022333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-642vt" Jun 06 16:48:55.029830 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.029809 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjp89\"" Jun 06 16:48:55.037014 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.036987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:48:55.148823 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.148791 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-642vt"] Jun 06 16:48:55.151957 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:48:55.151931 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5c6797_1b7e_4094_9dbe_454cde02bf5c.slice/crio-8278d28d01adb6e4b2dee3643b45f76d80fb92488b9d6d49cadb454aaab63d2d WatchSource:0}: Error finding container 8278d28d01adb6e4b2dee3643b45f76d80fb92488b9d6d49cadb454aaab63d2d: Status 404 returned error can't find the container with id 8278d28d01adb6e4b2dee3643b45f76d80fb92488b9d6d49cadb454aaab63d2d Jun 06 16:48:55.163944 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.163878 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kxtn"] Jun 06 16:48:55.167615 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:48:55.167588 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f0d819_ab76_4717_87a4_55016d4d91a8.slice/crio-575750068ad4f09a0ad7acbe1644312b160d58301e08ddb379c50e75df152127 WatchSource:0}: Error finding container 575750068ad4f09a0ad7acbe1644312b160d58301e08ddb379c50e75df152127: Status 404 returned error can't find the container with id 575750068ad4f09a0ad7acbe1644312b160d58301e08ddb379c50e75df152127 Jun 06 16:48:55.311033 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.310990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-642vt" event={"ID":"0c5c6797-1b7e-4094-9dbe-454cde02bf5c","Type":"ContainerStarted","Data":"8278d28d01adb6e4b2dee3643b45f76d80fb92488b9d6d49cadb454aaab63d2d"} Jun 06 16:48:55.312066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.312041 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kxtn" event={"ID":"93f0d819-ab76-4717-87a4-55016d4d91a8","Type":"ContainerStarted","Data":"575750068ad4f09a0ad7acbe1644312b160d58301e08ddb379c50e75df152127"} Jun 06 16:48:55.339645 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:55.339611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:48:55.339809 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:55.339788 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:48:55.339878 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:48:55.339871 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:49:27.339848672 +0000 UTC m=+98.772686198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:48:56.128793 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.128757 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd"] Jun 06 16:48:56.130890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.130863 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.135198 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.134958 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 06 16:48:56.135198 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.134988 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 06 16:48:56.135198 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.135007 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 06 16:48:56.135198 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.135017 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mbpr8\"" Jun 06 16:48:56.135198 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.134966 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 06 16:48:56.138294 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.138020 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq"] Jun 06 16:48:56.143378 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.141618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.144301 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.144277 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 06 16:48:56.146355 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.146314 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd"] Jun 06 16:48:56.149412 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.149392 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq"] Jun 06 16:48:56.247643 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.247605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9wzm\" (UniqueName: \"kubernetes.io/projected/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-kube-api-access-n9wzm\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.247833 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.247681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr55d\" (UniqueName: \"kubernetes.io/projected/339cbdb4-c4a3-4325-8c34-80ea06b85592-kube-api-access-cr55d\") pod \"managed-serviceaccount-addon-agent-7b76468c56-7jphd\" (UID: \"339cbdb4-c4a3-4325-8c34-80ea06b85592\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.247833 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.247711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.247833 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.247755 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/339cbdb4-c4a3-4325-8c34-80ea06b85592-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b76468c56-7jphd\" (UID: \"339cbdb4-c4a3-4325-8c34-80ea06b85592\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.247833 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.247816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-tmp\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.348346 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.348312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9wzm\" (UniqueName: \"kubernetes.io/projected/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-kube-api-access-n9wzm\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.348543 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.348390 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr55d\" (UniqueName: \"kubernetes.io/projected/339cbdb4-c4a3-4325-8c34-80ea06b85592-kube-api-access-cr55d\") pod \"managed-serviceaccount-addon-agent-7b76468c56-7jphd\" (UID: \"339cbdb4-c4a3-4325-8c34-80ea06b85592\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.348543 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.348427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.348543 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.348475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/339cbdb4-c4a3-4325-8c34-80ea06b85592-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b76468c56-7jphd\" (UID: \"339cbdb4-c4a3-4325-8c34-80ea06b85592\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.348543 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.348534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-tmp\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.348981 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.348954 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-tmp\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.351824 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.351796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.351824 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.351815 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/339cbdb4-c4a3-4325-8c34-80ea06b85592-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b76468c56-7jphd\" (UID: \"339cbdb4-c4a3-4325-8c34-80ea06b85592\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.357359 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.357331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr55d\" (UniqueName: \"kubernetes.io/projected/339cbdb4-c4a3-4325-8c34-80ea06b85592-kube-api-access-cr55d\") pod \"managed-serviceaccount-addon-agent-7b76468c56-7jphd\" (UID: \"339cbdb4-c4a3-4325-8c34-80ea06b85592\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.357772 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.357745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9wzm\" (UniqueName: \"kubernetes.io/projected/4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b-kube-api-access-n9wzm\") pod \"klusterlet-addon-workmgr-76d96f4c98-hbrnq\" (UID: \"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.471617 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.471462 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" Jun 06 16:48:56.480296 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.480270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:48:56.635674 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.635641 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq"] Jun 06 16:48:56.639061 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:48:56.639028 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd99d32_a8b1_43b6_bb0a_e9fcb8a8179b.slice/crio-78f40f616d1d76e189c96647758709f11c045e252af0d86e694cb7f6b465c2c7 WatchSource:0}: Error finding container 78f40f616d1d76e189c96647758709f11c045e252af0d86e694cb7f6b465c2c7: Status 404 returned error can't find the container with id 78f40f616d1d76e189c96647758709f11c045e252af0d86e694cb7f6b465c2c7 Jun 06 16:48:56.652212 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:56.652153 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd"] Jun 06 16:48:56.656111 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:48:56.656083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod339cbdb4_c4a3_4325_8c34_80ea06b85592.slice/crio-8ba77c4f061418afed4fda48a9d8946447967fcc5ffce058e9af871337a94c81 WatchSource:0}: Error finding container 8ba77c4f061418afed4fda48a9d8946447967fcc5ffce058e9af871337a94c81: Status 404 returned error can't find the container with id 8ba77c4f061418afed4fda48a9d8946447967fcc5ffce058e9af871337a94c81 Jun 06 16:48:57.319469 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:57.319417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" event={"ID":"339cbdb4-c4a3-4325-8c34-80ea06b85592","Type":"ContainerStarted","Data":"8ba77c4f061418afed4fda48a9d8946447967fcc5ffce058e9af871337a94c81"} Jun 06 16:48:57.320689 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:48:57.320632 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" event={"ID":"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b","Type":"ContainerStarted","Data":"78f40f616d1d76e189c96647758709f11c045e252af0d86e694cb7f6b465c2c7"} Jun 06 16:49:00.333601 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:00.333561 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kxtn" event={"ID":"93f0d819-ab76-4717-87a4-55016d4d91a8","Type":"ContainerStarted","Data":"5fd64be6bb1b805cb2b454ff96cca37f2f1c4cc47270af83c9decab41c02a852"} Jun 06 16:49:00.334064 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:00.333689 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:49:00.336205 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:00.336175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-642vt" event={"ID":"0c5c6797-1b7e-4094-9dbe-454cde02bf5c","Type":"ContainerStarted","Data":"05fa39da2fd3707ab2e178ee5af16ec3d6f9dc5f5cb956a5b549f4b352dd07fb"} Jun 06 16:49:00.350210 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:00.350138 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9kxtn" podStartSLOduration=66.731492418 podStartE2EDuration="1m11.350116961s" totalImagesPullingTime="4.618624543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:49:00.349312289 +0000 UTC m=+71.782149842" watchObservedRunningTime="2026-06-06 16:49:00.350116961 +0000 UTC m=+71.782954490" Jun 06 16:49:04.348176 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.348141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" event={"ID":"339cbdb4-c4a3-4325-8c34-80ea06b85592","Type":"ContainerStarted","Data":"4310dbbc86e583550c01b1d9f26e5aaddfcffccdafc75d1121eba65a7b8c7fe7"} Jun 06 16:49:04.349664 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.349643 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" event={"ID":"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b","Type":"ContainerStarted","Data":"f58d35ec77c2dfe675e3c98e6921d8a7c1344fe1dc582297f56af444138f4480"} Jun 06 16:49:04.349857 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.349841 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:49:04.351426 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.351393 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:49:04.362661 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.362624 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" podStartSLOduration=1.513553238 podStartE2EDuration="8.362610842s" totalImagesPullingTime="6.849057604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:49:04.362055255 +0000 UTC m=+75.794892787" watchObservedRunningTime="2026-06-06 16:49:04.362610842 +0000 UTC m=+75.795448397" Jun 06 16:49:04.362774 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.362692 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-642vt" podStartSLOduration=70.720670709 podStartE2EDuration="1m15.362686445s" totalImagesPullingTime="4.642015736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:49:00.362904294 +0000 UTC m=+71.795741819" watchObservedRunningTime="2026-06-06 16:49:04.362686445 +0000 UTC m=+75.795523978" Jun 06 16:49:04.378224 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:04.378182 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" podStartSLOduration=1.500401133 podStartE2EDuration="8.378166888s" totalImagesPullingTime="6.877765755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:49:04.377582483 +0000 UTC m=+75.810420015" watchObservedRunningTime="2026-06-06 16:49:04.378166888 +0000 UTC m=+75.811004442" Jun 06 16:49:27.359600 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:27.359496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:49:27.360002 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:49:27.359650 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:49:27.360002 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:49:27.359728 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:50:31.359711668 +0000 UTC m=+162.792549179 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:49:31.340722 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:31.340689 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9kxtn" Jun 06 16:49:58.869080 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:49:58.869035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:49:58.869610 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:49:58.869155 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 16:49:58.869610 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:49:58.869211 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs podName:e3f336c0-4fa1-4d84-844d-c76e88c994b7 nodeName:}" failed. No retries permitted until 2026-06-06 16:52:00.869196625 +0000 UTC m=+252.302034135 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs") pod "network-metrics-daemon-shnng" (UID: "e3f336c0-4fa1-4d84-844d-c76e88c994b7") : secret "metrics-daemon-secret" not found Jun 06 16:50:26.483025 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:50:26.482988 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bmh7j" podUID="f7289393-072f-4fa7-98ea-dcb6eb7c9614" Jun 06 16:50:26.572451 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:50:26.572413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmh7j" Jun 06 16:50:28.016653 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:50:28.016608 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-shnng" podUID="e3f336c0-4fa1-4d84-844d-c76e88c994b7" Jun 06 16:50:31.400803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:50:31.400758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:50:31.401300 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:50:31.400904 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 16:50:31.401300 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:50:31.400984 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls podName:f7289393-072f-4fa7-98ea-dcb6eb7c9614 nodeName:}" failed. No retries permitted until 2026-06-06 16:52:33.400966522 +0000 UTC m=+284.833804035 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls") pod "dns-default-bmh7j" (UID: "f7289393-072f-4fa7-98ea-dcb6eb7c9614") : secret "dns-default-metrics-tls" not found Jun 06 16:50:41.004707 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:50:41.004628 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:51:03.672978 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:03.672950 2572 generic.go:356] "Generic (PLEG): container finished" podID="339cbdb4-c4a3-4325-8c34-80ea06b85592" containerID="4310dbbc86e583550c01b1d9f26e5aaddfcffccdafc75d1121eba65a7b8c7fe7" exitCode=255 Jun 06 16:51:03.673406 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:03.673028 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" event={"ID":"339cbdb4-c4a3-4325-8c34-80ea06b85592","Type":"ContainerDied","Data":"4310dbbc86e583550c01b1d9f26e5aaddfcffccdafc75d1121eba65a7b8c7fe7"} Jun 06 16:51:03.673406 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:03.673393 2572 scope.go:117] "RemoveContainer" containerID="4310dbbc86e583550c01b1d9f26e5aaddfcffccdafc75d1121eba65a7b8c7fe7" Jun 06 16:51:03.674424 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:03.674403 2572 generic.go:356] "Generic (PLEG): container finished" podID="4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b" containerID="f58d35ec77c2dfe675e3c98e6921d8a7c1344fe1dc582297f56af444138f4480" exitCode=1 Jun 06 16:51:03.674558 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:03.674429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" event={"ID":"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b","Type":"ContainerDied","Data":"f58d35ec77c2dfe675e3c98e6921d8a7c1344fe1dc582297f56af444138f4480"} Jun 06 16:51:03.674734 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:03.674719 2572 scope.go:117] "RemoveContainer" containerID="f58d35ec77c2dfe675e3c98e6921d8a7c1344fe1dc582297f56af444138f4480" Jun 06 16:51:04.349986 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:04.349938 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:51:04.682702 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:04.682609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b76468c56-7jphd" event={"ID":"339cbdb4-c4a3-4325-8c34-80ea06b85592","Type":"ContainerStarted","Data":"9c70ffd03118491660530c7d5b1bd81471825f695286afa3c30f519669e539c3"} Jun 06 16:51:04.684197 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:04.684171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" event={"ID":"4dd99d32-a8b1-43b6-bb0a-e9fcb8a8179b","Type":"ContainerStarted","Data":"23854523e870afdf69c9222f50080d56511c72c3d3d070e5785108515b78d995"} Jun 06 16:51:04.684400 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:04.684384 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:51:04.684950 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:04.684935 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d96f4c98-hbrnq" Jun 06 16:51:10.096858 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.096826 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-677b5f8c9-xdx5c"] Jun 06 16:51:10.099771 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.099744 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.102427 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.102408 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 16:51:10.104859 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.104811 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 16:51:10.105055 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.105027 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 16:51:10.105142 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.105109 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n4rxq\"" Jun 06 16:51:10.113779 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.113745 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 16:51:10.115001 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.114975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-677b5f8c9-xdx5c"] Jun 06 16:51:10.166974 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.166940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmlf\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-kube-api-access-lsmlf\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.166997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-installation-pull-secrets\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.167022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-certificates\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.167091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-trusted-ca\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.167131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/def7d34c-77f4-49a0-bbb7-735dc8407e14-ca-trust-extracted\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.167169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-image-registry-private-configuration\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.167184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.167211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.167202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-bound-sa-token\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.184362 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.184329 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5"] Jun 06 16:51:10.187242 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.187169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.189729 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.189704 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 06 16:51:10.189851 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.189835 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kbz87\"" Jun 06 16:51:10.189932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.189887 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 06 16:51:10.189994 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.189959 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 06 16:51:10.190200 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.190185 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:51:10.195857 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.195833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5"] Jun 06 16:51:10.268293 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-bound-sa-token\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268512 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268305 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmlf\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-kube-api-access-lsmlf\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268512 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-installation-pull-secrets\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268512 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ec73c97-607e-43ec-aa5d-6562fd6bce35-config\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.268512 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-certificates\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-trusted-ca\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n5nl\" (UniqueName: \"kubernetes.io/projected/8ec73c97-607e-43ec-aa5d-6562fd6bce35-kube-api-access-6n5nl\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.268710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/def7d34c-77f4-49a0-bbb7-735dc8407e14-ca-trust-extracted\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-image-registry-private-configuration\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268917 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.268917 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.268789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec73c97-607e-43ec-aa5d-6562fd6bce35-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.268917 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:10.268887 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:51:10.268917 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:10.268906 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-677b5f8c9-xdx5c: secret "image-registry-tls" not found Jun 06 16:51:10.269108 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:10.268976 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls podName:def7d34c-77f4-49a0-bbb7-735dc8407e14 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:10.768955583 +0000 UTC m=+202.201793112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls") pod "image-registry-677b5f8c9-xdx5c" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14") : secret "image-registry-tls" not found Jun 06 16:51:10.269108 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.269015 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/def7d34c-77f4-49a0-bbb7-735dc8407e14-ca-trust-extracted\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.269224 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.269122 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-certificates\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.269461 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.269422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-trusted-ca\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.270751 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.270731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-installation-pull-secrets\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.270865 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.270846 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-image-registry-private-configuration\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.278849 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.278823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-bound-sa-token\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.281712 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.281691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmlf\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-kube-api-access-lsmlf\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.369799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.369694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec73c97-607e-43ec-aa5d-6562fd6bce35-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.369799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.369763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ec73c97-607e-43ec-aa5d-6562fd6bce35-config\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.369799 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.369792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n5nl\" (UniqueName: \"kubernetes.io/projected/8ec73c97-607e-43ec-aa5d-6562fd6bce35-kube-api-access-6n5nl\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.370362 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.370340 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ec73c97-607e-43ec-aa5d-6562fd6bce35-config\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.371942 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.371925 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec73c97-607e-43ec-aa5d-6562fd6bce35-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.377500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.377481 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n5nl\" (UniqueName: \"kubernetes.io/projected/8ec73c97-607e-43ec-aa5d-6562fd6bce35-kube-api-access-6n5nl\") pod \"service-ca-operator-6bc5ff68f5-lxbg5\" (UID: \"8ec73c97-607e-43ec-aa5d-6562fd6bce35\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.495679 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.495641 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" Jun 06 16:51:10.615396 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.615271 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5"] Jun 06 16:51:10.617787 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:10.617763 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec73c97_607e_43ec_aa5d_6562fd6bce35.slice/crio-ca39fc5c377778dd1aba14252b260aacf5318d68069453fd7a9ff03e9b0bce89 WatchSource:0}: Error finding container ca39fc5c377778dd1aba14252b260aacf5318d68069453fd7a9ff03e9b0bce89: Status 404 returned error can't find the container with id ca39fc5c377778dd1aba14252b260aacf5318d68069453fd7a9ff03e9b0bce89 Jun 06 16:51:10.702938 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.702897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" event={"ID":"8ec73c97-607e-43ec-aa5d-6562fd6bce35","Type":"ContainerStarted","Data":"ca39fc5c377778dd1aba14252b260aacf5318d68069453fd7a9ff03e9b0bce89"} Jun 06 16:51:10.772863 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:10.772828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:10.772991 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:10.772945 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:51:10.772991 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:10.772956 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-677b5f8c9-xdx5c: secret "image-registry-tls" not found Jun 06 16:51:10.773075 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:10.773004 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls podName:def7d34c-77f4-49a0-bbb7-735dc8407e14 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:11.772991315 +0000 UTC m=+203.205828825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls") pod "image-registry-677b5f8c9-xdx5c" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14") : secret "image-registry-tls" not found Jun 06 16:51:11.780478 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:11.780416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:11.780868 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:11.780572 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:51:11.780868 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:11.780590 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-677b5f8c9-xdx5c: secret "image-registry-tls" not found Jun 06 16:51:11.780868 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:11.780647 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls podName:def7d34c-77f4-49a0-bbb7-735dc8407e14 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:13.780628192 +0000 UTC m=+205.213465701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls") pod "image-registry-677b5f8c9-xdx5c" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14") : secret "image-registry-tls" not found Jun 06 16:51:13.713009 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:13.712974 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" event={"ID":"8ec73c97-607e-43ec-aa5d-6562fd6bce35","Type":"ContainerStarted","Data":"a3219cb7dc31aaa53c0c543b07fbe0f3e62ac024ebfab94de757e00a31e14883"} Jun 06 16:51:13.727116 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:13.727069 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" podStartSLOduration=1.566464223 podStartE2EDuration="3.727054259s" totalImagesPullingTime="2.160590036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:13.726467296 +0000 UTC m=+205.159304827" watchObservedRunningTime="2026-06-06 16:51:13.727054259 +0000 UTC m=+205.159891791" Jun 06 16:51:13.797025 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:13.796985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:13.797181 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:13.797162 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:51:13.797223 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:13.797183 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-677b5f8c9-xdx5c: secret "image-registry-tls" not found Jun 06 16:51:13.797267 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:13.797241 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls podName:def7d34c-77f4-49a0-bbb7-735dc8407e14 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:17.797223582 +0000 UTC m=+209.230061093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls") pod "image-registry-677b5f8c9-xdx5c" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14") : secret "image-registry-tls" not found Jun 06 16:51:16.473544 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:16.473517 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96bcr_c9bedaf8-c988-4514-b190-1cce9f971446/dns-node-resolver/0.log" Jun 06 16:51:17.474025 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:17.473996 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bshh4_bb76a589-8bc2-4d18-9930-a9faaf997801/node-ca/0.log" Jun 06 16:51:17.828487 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:17.828454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:17.828657 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:17.828619 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 16:51:17.828657 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:17.828643 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-677b5f8c9-xdx5c: secret "image-registry-tls" not found Jun 06 16:51:17.828730 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:51:17.828703 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls podName:def7d34c-77f4-49a0-bbb7-735dc8407e14 nodeName:}" failed. No retries permitted until 2026-06-06 16:51:25.828685404 +0000 UTC m=+217.261522917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls") pod "image-registry-677b5f8c9-xdx5c" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14") : secret "image-registry-tls" not found Jun 06 16:51:18.473512 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:18.473476 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vqmt_854d87df-39cd-4497-9d16-f4939fff2982/serve-healthcheck-canary/0.log" Jun 06 16:51:25.892500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:25.892463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:25.894933 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:25.894903 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"image-registry-677b5f8c9-xdx5c\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:26.009599 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:26.009543 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:26.133134 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:26.133101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-677b5f8c9-xdx5c"] Jun 06 16:51:26.136487 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:26.136422 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef7d34c_77f4_49a0_bbb7_735dc8407e14.slice/crio-de1f00fd223a7a86c91b4b410392bac9aa697b5c003d5ece19ecc21b82cbd9e4 WatchSource:0}: Error finding container de1f00fd223a7a86c91b4b410392bac9aa697b5c003d5ece19ecc21b82cbd9e4: Status 404 returned error can't find the container with id de1f00fd223a7a86c91b4b410392bac9aa697b5c003d5ece19ecc21b82cbd9e4 Jun 06 16:51:26.751078 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:26.751037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" event={"ID":"def7d34c-77f4-49a0-bbb7-735dc8407e14","Type":"ContainerStarted","Data":"63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972"} Jun 06 16:51:26.751261 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:26.751090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" event={"ID":"def7d34c-77f4-49a0-bbb7-735dc8407e14","Type":"ContainerStarted","Data":"de1f00fd223a7a86c91b4b410392bac9aa697b5c003d5ece19ecc21b82cbd9e4"} Jun 06 16:51:26.751261 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:26.751172 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:51:26.769641 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:26.769585 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" podStartSLOduration=16.769570218 podStartE2EDuration="16.769570218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:26.768327324 +0000 UTC m=+218.201164854" watchObservedRunningTime="2026-06-06 16:51:26.769570218 +0000 UTC m=+218.202407750" Jun 06 16:51:37.467522 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.467487 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-677b5f8c9-xdx5c"] Jun 06 16:51:37.480340 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.480315 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vbb75"] Jun 06 16:51:37.484444 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.484418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.486988 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.486965 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 16:51:37.486988 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.486980 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 16:51:37.487126 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.487034 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dk5mp\"" Jun 06 16:51:37.487311 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.487296 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 16:51:37.487605 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.487592 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 16:51:37.497764 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.497740 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbb75"] Jun 06 16:51:37.516073 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.516048 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-787c4494db-gnp2r"] Jun 06 16:51:37.520182 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.520160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.533817 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.533748 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-787c4494db-gnp2r"] Jun 06 16:51:37.582295 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.582256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.582295 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.582298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.582526 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.582346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8v4r\" (UniqueName: \"kubernetes.io/projected/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-kube-api-access-b8v4r\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.582526 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.582376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-crio-socket\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.582526 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.582403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-data-volume\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.683626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5kj2\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-kube-api-access-h5kj2\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.683626 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8v4r\" (UniqueName: \"kubernetes.io/projected/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-kube-api-access-b8v4r\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.683873 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-crio-socket\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.683873 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-data-volume\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.683873 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683733 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-crio-socket\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.683873 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b23647cf-9dfa-4cf6-8b07-e205e4612659-trusted-ca\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.683873 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b23647cf-9dfa-4cf6-8b07-e205e4612659-ca-trust-extracted\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.683873 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683835 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-registry-tls\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.684066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b23647cf-9dfa-4cf6-8b07-e205e4612659-image-registry-private-configuration\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.684066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b23647cf-9dfa-4cf6-8b07-e205e4612659-registry-certificates\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.684066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.683986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-bound-sa-token\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.684066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.684026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.684066 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.684049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-data-volume\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.684232 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.684088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b23647cf-9dfa-4cf6-8b07-e205e4612659-installation-pull-secrets\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.684232 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.684127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.684612 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.684582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.686246 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.686226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.695597 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.695577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8v4r\" (UniqueName: \"kubernetes.io/projected/d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8-kube-api-access-b8v4r\") pod \"insights-runtime-extractor-vbb75\" (UID: \"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8\") " pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.785095 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b23647cf-9dfa-4cf6-8b07-e205e4612659-trusted-ca\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785247 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b23647cf-9dfa-4cf6-8b07-e205e4612659-ca-trust-extracted\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785247 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-registry-tls\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785247 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b23647cf-9dfa-4cf6-8b07-e205e4612659-image-registry-private-configuration\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785247 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b23647cf-9dfa-4cf6-8b07-e205e4612659-registry-certificates\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785247 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785233 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-bound-sa-token\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785556 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b23647cf-9dfa-4cf6-8b07-e205e4612659-installation-pull-secrets\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785556 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785297 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5kj2\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-kube-api-access-h5kj2\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.785658 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.785558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b23647cf-9dfa-4cf6-8b07-e205e4612659-ca-trust-extracted\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.786096 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.786061 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b23647cf-9dfa-4cf6-8b07-e205e4612659-registry-certificates\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.786219 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.786124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b23647cf-9dfa-4cf6-8b07-e205e4612659-trusted-ca\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.787625 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.787601 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b23647cf-9dfa-4cf6-8b07-e205e4612659-image-registry-private-configuration\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.787791 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.787767 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b23647cf-9dfa-4cf6-8b07-e205e4612659-installation-pull-secrets\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.787862 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.787847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-registry-tls\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.792861 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.792841 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-bound-sa-token\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.792955 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.792942 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbb75" Jun 06 16:51:37.793280 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.793264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5kj2\" (UniqueName: \"kubernetes.io/projected/b23647cf-9dfa-4cf6-8b07-e205e4612659-kube-api-access-h5kj2\") pod \"image-registry-787c4494db-gnp2r\" (UID: \"b23647cf-9dfa-4cf6-8b07-e205e4612659\") " pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.828784 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.828750 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:37.934226 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.934135 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbb75"] Jun 06 16:51:37.937537 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:37.937510 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f1a5ba_f3db_433f_bf40_1522c0c4b5f8.slice/crio-cbccc381982b689be8f63190a135e45c417b880cb1e22f319228b3062e6f946e WatchSource:0}: Error finding container cbccc381982b689be8f63190a135e45c417b880cb1e22f319228b3062e6f946e: Status 404 returned error can't find the container with id cbccc381982b689be8f63190a135e45c417b880cb1e22f319228b3062e6f946e Jun 06 16:51:37.990353 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:37.990211 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-787c4494db-gnp2r"] Jun 06 16:51:37.992772 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:37.992749 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23647cf_9dfa_4cf6_8b07_e205e4612659.slice/crio-ce123246fdc251e0560b286ae0f27c8acebbdb288f3dca7379fd7b6bf7b5fe48 WatchSource:0}: Error finding container ce123246fdc251e0560b286ae0f27c8acebbdb288f3dca7379fd7b6bf7b5fe48: Status 404 returned error can't find the container with id ce123246fdc251e0560b286ae0f27c8acebbdb288f3dca7379fd7b6bf7b5fe48 Jun 06 16:51:38.786126 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.786092 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbb75" event={"ID":"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8","Type":"ContainerStarted","Data":"ff35513c21af9cee6f47ca64f650782ebbf172abc0d2f4fd79d92c43634996be"} Jun 06 16:51:38.786547 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.786159 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbb75" event={"ID":"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8","Type":"ContainerStarted","Data":"92fac3b6255330ca407feb98d6def1c52ab8d2df662596bce9cc522734e8e1df"} Jun 06 16:51:38.786547 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.786191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbb75" event={"ID":"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8","Type":"ContainerStarted","Data":"cbccc381982b689be8f63190a135e45c417b880cb1e22f319228b3062e6f946e"} Jun 06 16:51:38.787373 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.787349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" event={"ID":"b23647cf-9dfa-4cf6-8b07-e205e4612659","Type":"ContainerStarted","Data":"099c80e38cfc484b3adb07164b173fc1ed40c1d62d21083f83b128a4a5a530ec"} Jun 06 16:51:38.787461 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.787389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" event={"ID":"b23647cf-9dfa-4cf6-8b07-e205e4612659","Type":"ContainerStarted","Data":"ce123246fdc251e0560b286ae0f27c8acebbdb288f3dca7379fd7b6bf7b5fe48"} Jun 06 16:51:38.787510 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.787496 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:51:38.809250 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:38.809200 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podStartSLOduration=1.809182466 podStartE2EDuration="1.809182466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:38.808901159 +0000 UTC m=+230.241738716" watchObservedRunningTime="2026-06-06 16:51:38.809182466 +0000 UTC m=+230.242019990" Jun 06 16:51:40.796544 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:40.796507 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbb75" event={"ID":"d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8","Type":"ContainerStarted","Data":"cfcd4ac1021a6808009838a21dd2519799b06684e832965c853c567a17941d0b"} Jun 06 16:51:40.812970 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:40.812891 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vbb75" podStartSLOduration=1.689042525 podStartE2EDuration="3.81287469s" totalImagesPullingTime="2.123832165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 16:51:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:40.812667006 +0000 UTC m=+232.245504538" watchObservedRunningTime="2026-06-06 16:51:40.81287469 +0000 UTC m=+232.245712222" Jun 06 16:51:46.545195 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.545161 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw"] Jun 06 16:51:46.550356 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.550336 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.553935 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.553913 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 06 16:51:46.554117 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.554105 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 16:51:46.554190 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.554108 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 06 16:51:46.555640 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.555620 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 16:51:46.555640 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.555636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2n4w9\"" Jun 06 16:51:46.555771 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.555625 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 16:51:46.570246 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.570222 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw"] Jun 06 16:51:46.650827 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.650792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5prl\" (UniqueName: \"kubernetes.io/projected/3f004063-e294-42d1-8f6e-8a73280a9d26-kube-api-access-t5prl\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.650994 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.650847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f004063-e294-42d1-8f6e-8a73280a9d26-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.650994 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.650864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f004063-e294-42d1-8f6e-8a73280a9d26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.650994 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.650933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f004063-e294-42d1-8f6e-8a73280a9d26-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.752302 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.752262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5prl\" (UniqueName: \"kubernetes.io/projected/3f004063-e294-42d1-8f6e-8a73280a9d26-kube-api-access-t5prl\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.752477 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.752323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f004063-e294-42d1-8f6e-8a73280a9d26-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.752477 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.752344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f004063-e294-42d1-8f6e-8a73280a9d26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.752477 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.752365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f004063-e294-42d1-8f6e-8a73280a9d26-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.753049 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.753026 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f004063-e294-42d1-8f6e-8a73280a9d26-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.754804 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.754785 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f004063-e294-42d1-8f6e-8a73280a9d26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.754876 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.754852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f004063-e294-42d1-8f6e-8a73280a9d26-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.760132 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.760098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5prl\" (UniqueName: \"kubernetes.io/projected/3f004063-e294-42d1-8f6e-8a73280a9d26-kube-api-access-t5prl\") pod \"prometheus-operator-7f7d445d84-wp4jw\" (UID: \"3f004063-e294-42d1-8f6e-8a73280a9d26\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.859272 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.859188 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" Jun 06 16:51:46.986055 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:46.986013 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw"] Jun 06 16:51:46.988674 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:46.988649 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f004063_e294_42d1_8f6e_8a73280a9d26.slice/crio-34f1ef849d3017ff31b815bfacbf410e7ebd86083e26517d5d58c3bc40f109f8 WatchSource:0}: Error finding container 34f1ef849d3017ff31b815bfacbf410e7ebd86083e26517d5d58c3bc40f109f8: Status 404 returned error can't find the container with id 34f1ef849d3017ff31b815bfacbf410e7ebd86083e26517d5d58c3bc40f109f8 Jun 06 16:51:47.473751 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:47.473704 2572 patch_prober.go:28] interesting pod/image-registry-677b5f8c9-xdx5c container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:51:47.473917 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:47.473768 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:51:47.820678 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:47.820596 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" event={"ID":"3f004063-e294-42d1-8f6e-8a73280a9d26","Type":"ContainerStarted","Data":"34f1ef849d3017ff31b815bfacbf410e7ebd86083e26517d5d58c3bc40f109f8"} Jun 06 16:51:48.825371 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:48.825324 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" event={"ID":"3f004063-e294-42d1-8f6e-8a73280a9d26","Type":"ContainerStarted","Data":"ed1695836070e7558771c17b8e2ddbaf890025d72652ad79e39decce4e9cd06b"} Jun 06 16:51:48.825876 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:48.825427 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" event={"ID":"3f004063-e294-42d1-8f6e-8a73280a9d26","Type":"ContainerStarted","Data":"e012493407bb4e51ede7b412ce3a20e908bfba029eb9a8f9ebd2d6e45dbc8c18"} Jun 06 16:51:48.842163 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:48.842116 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wp4jw" podStartSLOduration=1.674011144 podStartE2EDuration="2.842102421s" totalImagesPullingTime="1.168091277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:48.840369563 +0000 UTC m=+240.273207094" watchObservedRunningTime="2026-06-06 16:51:48.842102421 +0000 UTC m=+240.274939953" Jun 06 16:51:50.875548 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.875518 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q8zcf"] Jun 06 16:51:50.878839 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.878819 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.881692 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.881663 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 16:51:50.881807 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.881707 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2snng\"" Jun 06 16:51:50.881807 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.881727 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 16:51:50.881807 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.881707 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 16:51:50.983592 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983552 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fda115-8a33-444b-8cf4-89028fd67197-metrics-client-ca\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983592 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-tls\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-accelerators-collector-config\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-sys\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qfn\" (UniqueName: \"kubernetes.io/projected/37fda115-8a33-444b-8cf4-89028fd67197-kube-api-access-54qfn\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983984 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-wtmp\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983984 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-textfile\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:50.983984 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:50.983882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-root\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.084905 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.084867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-sys\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.084905 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.084914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qfn\" (UniqueName: \"kubernetes.io/projected/37fda115-8a33-444b-8cf4-89028fd67197-kube-api-access-54qfn\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.084985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-sys\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085045 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-wtmp\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-textfile\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-root\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085266 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fda115-8a33-444b-8cf4-89028fd67197-metrics-client-ca\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085266 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-tls\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085266 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-wtmp\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085266 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37fda115-8a33-444b-8cf4-89028fd67197-root\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085266 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085208 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-accelerators-collector-config\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085530 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085624 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085603 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-textfile\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085851 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37fda115-8a33-444b-8cf4-89028fd67197-metrics-client-ca\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.085851 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.085822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-accelerators-collector-config\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.087638 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.087618 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.087813 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.087792 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37fda115-8a33-444b-8cf4-89028fd67197-node-exporter-tls\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.092238 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.092214 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qfn\" (UniqueName: \"kubernetes.io/projected/37fda115-8a33-444b-8cf4-89028fd67197-kube-api-access-54qfn\") pod \"node-exporter-q8zcf\" (UID: \"37fda115-8a33-444b-8cf4-89028fd67197\") " pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.187795 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.187705 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q8zcf" Jun 06 16:51:51.199898 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:51.199870 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fda115_8a33_444b_8cf4_89028fd67197.slice/crio-72d23934c22210d2350a06ca473bdc3ba68ffd03398fdac319f159d95804d4c9 WatchSource:0}: Error finding container 72d23934c22210d2350a06ca473bdc3ba68ffd03398fdac319f159d95804d4c9: Status 404 returned error can't find the container with id 72d23934c22210d2350a06ca473bdc3ba68ffd03398fdac319f159d95804d4c9 Jun 06 16:51:51.837177 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:51.837136 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8zcf" event={"ID":"37fda115-8a33-444b-8cf4-89028fd67197","Type":"ContainerStarted","Data":"72d23934c22210d2350a06ca473bdc3ba68ffd03398fdac319f159d95804d4c9"} Jun 06 16:51:52.842345 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:52.842311 2572 generic.go:356] "Generic (PLEG): container finished" podID="37fda115-8a33-444b-8cf4-89028fd67197" containerID="23193bdcd42da148644e0d91bf56b7c963e6b91b039b066cd788c7782285fe37" exitCode=0 Jun 06 16:51:52.842832 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:52.842349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8zcf" event={"ID":"37fda115-8a33-444b-8cf4-89028fd67197","Type":"ContainerDied","Data":"23193bdcd42da148644e0d91bf56b7c963e6b91b039b066cd788c7782285fe37"} Jun 06 16:51:53.850013 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.849974 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k"] Jun 06 16:51:53.853766 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.853740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8zcf" event={"ID":"37fda115-8a33-444b-8cf4-89028fd67197","Type":"ContainerStarted","Data":"2c3c6d3e791c27f2712f259b2cb66698f374a4d688ab885dc138af9e170d16ed"} Jun 06 16:51:53.853887 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.853772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8zcf" event={"ID":"37fda115-8a33-444b-8cf4-89028fd67197","Type":"ContainerStarted","Data":"f5af32045b1f9589067ed2c1af7cb2c227e7b7f317ada3a3ef5bfe1a949b3593"} Jun 06 16:51:53.853887 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.853851 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.856725 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.856702 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 06 16:51:53.856858 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.856738 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 06 16:51:53.856858 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.856752 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bgnbf0cvucj91\"" Jun 06 16:51:53.856858 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.856705 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 06 16:51:53.856858 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.856839 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-chjzv\"" Jun 06 16:51:53.857063 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.857000 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 06 16:51:53.857063 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.857005 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 06 16:51:53.863768 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.863748 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k"] Jun 06 16:51:53.874078 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.874037 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q8zcf" podStartSLOduration=2.901477253 podStartE2EDuration="3.8740233s" totalImagesPullingTime="904.50072ms" totalInitContainerRuntime="68.045327ms" isStatefulPod=true podCreationTimestamp="2026-06-06 16:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:53.872655455 +0000 UTC m=+245.305492987" watchObservedRunningTime="2026-06-06 16:51:53.8740233 +0000 UTC m=+245.306860832" Jun 06 16:51:53.905451 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905608 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905608 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905541 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905715 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ce94afd-8ad0-4058-bcc7-b1900d22a194-metrics-client-ca\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905767 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-grpc-tls\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905955 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzm6z\" (UniqueName: \"kubernetes.io/projected/7ce94afd-8ad0-4058-bcc7-b1900d22a194-kube-api-access-vzm6z\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:53.905999 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:53.905963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-tls\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.006865 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.006828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.006879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzm6z\" (UniqueName: \"kubernetes.io/projected/7ce94afd-8ad0-4058-bcc7-b1900d22a194-kube-api-access-vzm6z\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.006898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-tls\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.006921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.006965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.006986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007288 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.007051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ce94afd-8ad0-4058-bcc7-b1900d22a194-metrics-client-ca\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.007288 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.007083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-grpc-tls\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.008008 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.007971 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ce94afd-8ad0-4058-bcc7-b1900d22a194-metrics-client-ca\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.009672 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.009566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.009769 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.009732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-grpc-tls\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.009875 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.009854 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.009979 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.009963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.010042 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.009967 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.010130 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.010112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7ce94afd-8ad0-4058-bcc7-b1900d22a194-secret-thanos-querier-tls\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.015411 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.015391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzm6z\" (UniqueName: \"kubernetes.io/projected/7ce94afd-8ad0-4058-bcc7-b1900d22a194-kube-api-access-vzm6z\") pod \"thanos-querier-7dd7fbdcd4-46p6k\" (UID: \"7ce94afd-8ad0-4058-bcc7-b1900d22a194\") " pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.163179 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.163091 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:54.294491 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.294458 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k"] Jun 06 16:51:54.298150 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:51:54.298123 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce94afd_8ad0_4058_bcc7_b1900d22a194.slice/crio-c38b2d8678957d4c4af8d2845f553b01f6a9c955b093171b424461a1d3b7ec01 WatchSource:0}: Error finding container c38b2d8678957d4c4af8d2845f553b01f6a9c955b093171b424461a1d3b7ec01: Status 404 returned error can't find the container with id c38b2d8678957d4c4af8d2845f553b01f6a9c955b093171b424461a1d3b7ec01 Jun 06 16:51:54.857012 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:54.856972 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"c38b2d8678957d4c4af8d2845f553b01f6a9c955b093171b424461a1d3b7ec01"} Jun 06 16:51:56.867904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:56.867872 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"79979494fa8c4b364753e2adf14d57895105a9e189146372ad40de920979e871"} Jun 06 16:51:56.868307 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:56.867981 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"a6e4f31bb34d4ba4ffa6fe95f3c3ad2c257fa81be65e085deab5dd587b93c7b0"} Jun 06 16:51:56.868307 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:56.868022 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"6ddfc362d0726c5d2c75740a05650c8c745e86bf2278b764134f6037ead11605"} Jun 06 16:51:57.472216 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.472180 2572 patch_prober.go:28] interesting pod/image-registry-677b5f8c9-xdx5c container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:51:57.472397 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.472238 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:51:57.833285 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.833252 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:51:57.833463 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.833303 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:51:57.873607 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.873575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"9e2adaf66459262074051339bc01ea13e16cb7b5d0450f3ae4beb25284c7c6c7"} Jun 06 16:51:57.873953 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.873636 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"e13d3003f4b9c3608b6c901964cad930c4c659125dbbcb3eccb730e9afd84040"} Jun 06 16:51:57.873953 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.873663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" event={"ID":"7ce94afd-8ad0-4058-bcc7-b1900d22a194","Type":"ContainerStarted","Data":"d69cc8db3adf151d2c906d36d6dcd062bf2034507422064dd357a170767f75f1"} Jun 06 16:51:57.873953 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.873714 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:51:57.895704 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:57.895657 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" podStartSLOduration=2.561097909 podStartE2EDuration="4.895642546s" totalImagesPullingTime="2.334544637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:51:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:51:57.893661241 +0000 UTC m=+249.326498771" watchObservedRunningTime="2026-06-06 16:51:57.895642546 +0000 UTC m=+249.328480096" Jun 06 16:51:59.795502 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:59.795462 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:51:59.795866 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:51:59.795523 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:00.969523 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:00.969480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:52:00.971893 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:00.971868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f336c0-4fa1-4d84-844d-c76e88c994b7-metrics-certs\") pod \"network-metrics-daemon-shnng\" (UID: \"e3f336c0-4fa1-4d84-844d-c76e88c994b7\") " pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:52:01.108833 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:01.108802 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbbrh\"" Jun 06 16:52:01.116097 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:01.116079 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shnng" Jun 06 16:52:01.237493 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:01.237464 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shnng"] Jun 06 16:52:01.241289 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:52:01.241264 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f336c0_4fa1_4d84_844d_c76e88c994b7.slice/crio-3ef6111f6a12b8bf098c86cec1a020d6ae51803616685c6a13ab64e298246c69 WatchSource:0}: Error finding container 3ef6111f6a12b8bf098c86cec1a020d6ae51803616685c6a13ab64e298246c69: Status 404 returned error can't find the container with id 3ef6111f6a12b8bf098c86cec1a020d6ae51803616685c6a13ab64e298246c69 Jun 06 16:52:01.891788 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:01.891745 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shnng" event={"ID":"e3f336c0-4fa1-4d84-844d-c76e88c994b7","Type":"ContainerStarted","Data":"3ef6111f6a12b8bf098c86cec1a020d6ae51803616685c6a13ab64e298246c69"} Jun 06 16:52:02.487316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.487279 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerName="registry" containerID="cri-o://63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972" gracePeriod=30 Jun 06 16:52:02.730659 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.730633 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:52:02.784904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.784826 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-trusted-ca\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.784904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.784877 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-certificates\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.784904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.784902 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/def7d34c-77f4-49a0-bbb7-735dc8407e14-ca-trust-extracted\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.785150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.784946 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.785150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.784970 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsmlf\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-kube-api-access-lsmlf\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.785150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.785009 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-installation-pull-secrets\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.785150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.785050 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-bound-sa-token\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.785150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.785079 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-image-registry-private-configuration\") pod \"def7d34c-77f4-49a0-bbb7-735dc8407e14\" (UID: \"def7d34c-77f4-49a0-bbb7-735dc8407e14\") " Jun 06 16:52:02.785425 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.785390 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:52:02.785647 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.785617 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:52:02.787360 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.787327 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:52:02.787504 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.787384 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-kube-api-access-lsmlf" (OuterVolumeSpecName: "kube-api-access-lsmlf") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "kube-api-access-lsmlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:52:02.787593 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.787574 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:52:02.787636 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.787593 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:52:02.787681 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.787662 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:52:02.793650 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.793630 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def7d34c-77f4-49a0-bbb7-735dc8407e14-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "def7d34c-77f4-49a0-bbb7-735dc8407e14" (UID: "def7d34c-77f4-49a0-bbb7-735dc8407e14"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:52:02.886106 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886066 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsmlf\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-kube-api-access-lsmlf\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886106 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886096 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-installation-pull-secrets\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886106 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886109 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-bound-sa-token\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886120 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/def7d34c-77f4-49a0-bbb7-735dc8407e14-image-registry-private-configuration\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886130 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-trusted-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886138 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-certificates\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886147 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/def7d34c-77f4-49a0-bbb7-735dc8407e14-ca-trust-extracted\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.886358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.886155 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/def7d34c-77f4-49a0-bbb7-735dc8407e14-registry-tls\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:02.896588 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.896554 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shnng" event={"ID":"e3f336c0-4fa1-4d84-844d-c76e88c994b7","Type":"ContainerStarted","Data":"3a47acc6a604b093de2542fa4081477a42ec5af6d2df99f7d3190f78d60d3f8e"} Jun 06 16:52:02.896735 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.896616 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shnng" event={"ID":"e3f336c0-4fa1-4d84-844d-c76e88c994b7","Type":"ContainerStarted","Data":"1c5cef113ecaf78e96fac3c45cb13ead2399008826b6b310725845cf866c2e54"} Jun 06 16:52:02.897810 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.897788 2572 generic.go:356] "Generic (PLEG): container finished" podID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerID="63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972" exitCode=0 Jun 06 16:52:02.897913 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.897830 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" Jun 06 16:52:02.897913 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.897838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" event={"ID":"def7d34c-77f4-49a0-bbb7-735dc8407e14","Type":"ContainerDied","Data":"63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972"} Jun 06 16:52:02.897913 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.897869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-677b5f8c9-xdx5c" event={"ID":"def7d34c-77f4-49a0-bbb7-735dc8407e14","Type":"ContainerDied","Data":"de1f00fd223a7a86c91b4b410392bac9aa697b5c003d5ece19ecc21b82cbd9e4"} Jun 06 16:52:02.897913 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.897888 2572 scope.go:117] "RemoveContainer" containerID="63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972" Jun 06 16:52:02.907029 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.907007 2572 scope.go:117] "RemoveContainer" containerID="63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972" Jun 06 16:52:02.907276 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:52:02.907254 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972\": container with ID starting with 63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972 not found: ID does not exist" containerID="63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972" Jun 06 16:52:02.907356 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.907284 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972"} err="failed to get container status \"63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972\": rpc error: code = NotFound desc = could not find container \"63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972\": container with ID starting with 63d9561a7810761000a872cbed2a7943649eae7decc5e15408dab763fd9eb972 not found: ID does not exist" Jun 06 16:52:02.912100 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.912059 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-shnng" podStartSLOduration=253.030954245 podStartE2EDuration="4m13.912045418s" totalImagesPullingTime="881.091173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:02.911898992 +0000 UTC m=+254.344736524" watchObservedRunningTime="2026-06-06 16:52:02.912045418 +0000 UTC m=+254.344882949" Jun 06 16:52:02.928102 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.928079 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-677b5f8c9-xdx5c"] Jun 06 16:52:02.932306 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:02.932285 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-677b5f8c9-xdx5c"] Jun 06 16:52:03.009650 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:03.009620 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" path="/var/lib/kubelet/pods/def7d34c-77f4-49a0-bbb7-735dc8407e14/volumes" Jun 06 16:52:03.883211 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:03.883181 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dd7fbdcd4-46p6k" Jun 06 16:52:04.586095 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.586063 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9ff86c476-w2r27"] Jun 06 16:52:04.586311 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.586300 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerName="registry" Jun 06 16:52:04.586349 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.586313 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerName="registry" Jun 06 16:52:04.586378 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.586362 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="def7d34c-77f4-49a0-bbb7-735dc8407e14" containerName="registry" Jun 06 16:52:04.593727 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.593698 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.596703 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.596673 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9ff86c476-w2r27"] Jun 06 16:52:04.596928 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.596912 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 16:52:04.597004 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.596916 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 16:52:04.597056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.597006 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 16:52:04.597094 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.597064 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 16:52:04.598048 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.598027 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 16:52:04.598171 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.598057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9mvk2\"" Jun 06 16:52:04.598171 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.598142 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 16:52:04.598171 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.598157 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 16:52:04.701835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.701803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-oauth-serving-cert\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.701835 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.701839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-oauth-config\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.702050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.701890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-console-config\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.702050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.701939 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mswlc\" (UniqueName: \"kubernetes.io/projected/e308451d-76ef-451b-8491-d6bdb044c849-kube-api-access-mswlc\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.702050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.701971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-service-ca\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.702050 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.702009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-serving-cert\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.802644 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.802617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-console-config\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.802723 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.802654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mswlc\" (UniqueName: \"kubernetes.io/projected/e308451d-76ef-451b-8491-d6bdb044c849-kube-api-access-mswlc\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.802723 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.802688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-service-ca\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.802796 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.802723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-serving-cert\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.802796 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.802748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-oauth-serving-cert\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.802861 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.802796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-oauth-config\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.803484 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.803429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-console-config\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.803484 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.803452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-oauth-serving-cert\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.803484 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.803480 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-service-ca\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.805159 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.805137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-oauth-config\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.805244 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.805204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-serving-cert\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.810923 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.810902 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mswlc\" (UniqueName: \"kubernetes.io/projected/e308451d-76ef-451b-8491-d6bdb044c849-kube-api-access-mswlc\") pod \"console-9ff86c476-w2r27\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:04.904690 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:04.904592 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:05.046128 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:05.046090 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9ff86c476-w2r27"] Jun 06 16:52:05.049167 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:52:05.049125 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode308451d_76ef_451b_8491_d6bdb044c849.slice/crio-1e19bfede8ffd5a30ab96dc680b9caf896e6a1160faea7ae0bd5ccdf857bc609 WatchSource:0}: Error finding container 1e19bfede8ffd5a30ab96dc680b9caf896e6a1160faea7ae0bd5ccdf857bc609: Status 404 returned error can't find the container with id 1e19bfede8ffd5a30ab96dc680b9caf896e6a1160faea7ae0bd5ccdf857bc609 Jun 06 16:52:05.911172 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:05.911134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff86c476-w2r27" event={"ID":"e308451d-76ef-451b-8491-d6bdb044c849","Type":"ContainerStarted","Data":"1e19bfede8ffd5a30ab96dc680b9caf896e6a1160faea7ae0bd5ccdf857bc609"} Jun 06 16:52:07.833101 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:07.833070 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:52:07.833499 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:07.833129 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:07.921596 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:07.921558 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff86c476-w2r27" event={"ID":"e308451d-76ef-451b-8491-d6bdb044c849","Type":"ContainerStarted","Data":"45b4543888b5933402f70fff5b1aceb4f667d373c1f0ef10e87a92f14733500d"} Jun 06 16:52:07.939908 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:07.939807 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9ff86c476-w2r27" podStartSLOduration=1.308475456 podStartE2EDuration="3.939790613s" totalImagesPullingTime="2.631315157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:07.938996054 +0000 UTC m=+259.371833586" watchObservedRunningTime="2026-06-06 16:52:07.939790613 +0000 UTC m=+259.372628145" Jun 06 16:52:09.795422 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:09.795391 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:52:09.795894 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:09.795457 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:12.569007 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.568971 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766fbb4fb-wr7d2"] Jun 06 16:52:12.572918 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.572902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.581819 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.581796 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 16:52:12.582665 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.582645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766fbb4fb-wr7d2"] Jun 06 16:52:12.669143 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-oauth-config\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.669348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-trusted-ca-bundle\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.669348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669178 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-service-ca\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.669348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-oauth-serving-cert\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.669348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dfkc\" (UniqueName: \"kubernetes.io/projected/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-kube-api-access-2dfkc\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.669348 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669281 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-config\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.669604 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.669413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-serving-cert\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770443 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-serving-cert\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770656 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-oauth-config\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770656 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-trusted-ca-bundle\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770656 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-service-ca\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770808 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-oauth-serving-cert\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770808 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dfkc\" (UniqueName: \"kubernetes.io/projected/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-kube-api-access-2dfkc\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.770808 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.770792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-config\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.771519 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.771496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-config\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.771519 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.771509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-service-ca\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.771700 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.771526 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-oauth-serving-cert\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.771700 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.771662 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-trusted-ca-bundle\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.773010 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.772991 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-serving-cert\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.773104 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.773032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-oauth-config\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.778597 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.778572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dfkc\" (UniqueName: \"kubernetes.io/projected/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-kube-api-access-2dfkc\") pod \"console-766fbb4fb-wr7d2\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:12.882592 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:12.882503 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:13.012741 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:13.012712 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766fbb4fb-wr7d2"] Jun 06 16:52:13.015810 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:52:13.015768 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bffa62_2d3e_4d1b_afb6_b8bd9ecea918.slice/crio-584968eb114455b889b75e5e72619f02ed0d4bba6b469a27dad0d5a155cc46fb WatchSource:0}: Error finding container 584968eb114455b889b75e5e72619f02ed0d4bba6b469a27dad0d5a155cc46fb: Status 404 returned error can't find the container with id 584968eb114455b889b75e5e72619f02ed0d4bba6b469a27dad0d5a155cc46fb Jun 06 16:52:13.943981 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:13.943947 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766fbb4fb-wr7d2" event={"ID":"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918","Type":"ContainerStarted","Data":"fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474"} Jun 06 16:52:13.944366 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:13.943999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766fbb4fb-wr7d2" event={"ID":"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918","Type":"ContainerStarted","Data":"584968eb114455b889b75e5e72619f02ed0d4bba6b469a27dad0d5a155cc46fb"} Jun 06 16:52:13.960851 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:13.960795 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766fbb4fb-wr7d2" podStartSLOduration=1.960779283 podStartE2EDuration="1.960779283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:13.959425636 +0000 UTC m=+265.392263168" watchObservedRunningTime="2026-06-06 16:52:13.960779283 +0000 UTC m=+265.393616815" Jun 06 16:52:14.904936 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:14.904885 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:14.905115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:14.904990 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:14.906489 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:14.906464 2572 patch_prober.go:28] interesting pod/console-9ff86c476-w2r27 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 06 16:52:14.906597 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:14.906518 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9ff86c476-w2r27" podUID="e308451d-76ef-451b-8491-d6bdb044c849" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 06 16:52:17.832758 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:17.832728 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:52:17.833119 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:17.832783 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:17.833119 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:17.832822 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:52:17.833263 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:17.833246 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"099c80e38cfc484b3adb07164b173fc1ed40c1d62d21083f83b128a4a5a530ec"} pod="openshift-image-registry/image-registry-787c4494db-gnp2r" containerMessage="Container registry failed liveness probe, will be restarted" Jun 06 16:52:17.836807 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:17.836781 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:52:17.836946 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:17.836829 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:18.964146 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:18.964107 2572 generic.go:356] "Generic (PLEG): container finished" podID="8ec73c97-607e-43ec-aa5d-6562fd6bce35" containerID="a3219cb7dc31aaa53c0c543b07fbe0f3e62ac024ebfab94de757e00a31e14883" exitCode=0 Jun 06 16:52:18.964615 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:18.964178 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" event={"ID":"8ec73c97-607e-43ec-aa5d-6562fd6bce35","Type":"ContainerDied","Data":"a3219cb7dc31aaa53c0c543b07fbe0f3e62ac024ebfab94de757e00a31e14883"} Jun 06 16:52:18.964615 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:18.964581 2572 scope.go:117] "RemoveContainer" containerID="a3219cb7dc31aaa53c0c543b07fbe0f3e62ac024ebfab94de757e00a31e14883" Jun 06 16:52:19.968928 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:19.968890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lxbg5" event={"ID":"8ec73c97-607e-43ec-aa5d-6562fd6bce35","Type":"ContainerStarted","Data":"57a322967523abbef0a845dae7e3df72b15b0e816492ec7a4f452c8d664093ad"} Jun 06 16:52:22.882895 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:22.882859 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:22.883316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:22.882932 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:22.883910 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:22.883885 2572 patch_prober.go:28] interesting pod/console-766fbb4fb-wr7d2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 06 16:52:22.884024 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:22.883925 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-766fbb4fb-wr7d2" podUID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 06 16:52:24.909585 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:24.909556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:24.913231 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:24.913203 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:27.836992 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:27.836954 2572 patch_prober.go:28] interesting pod/image-registry-787c4494db-gnp2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 16:52:27.837358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:27.837007 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:52:29.573185 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:52:29.573139 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bmh7j" podUID="f7289393-072f-4fa7-98ea-dcb6eb7c9614" Jun 06 16:52:30.005511 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:30.005482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmh7j" Jun 06 16:52:32.886997 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:32.886963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:32.890604 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:32.890582 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:52:32.945774 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:32.945741 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9ff86c476-w2r27"] Jun 06 16:52:33.449536 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:33.449500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:52:33.451742 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:33.451713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7289393-072f-4fa7-98ea-dcb6eb7c9614-metrics-tls\") pod \"dns-default-bmh7j\" (UID: \"f7289393-072f-4fa7-98ea-dcb6eb7c9614\") " pod="openshift-dns/dns-default-bmh7j" Jun 06 16:52:33.608992 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:33.608955 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6gpx\"" Jun 06 16:52:33.616663 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:33.616639 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmh7j" Jun 06 16:52:33.740562 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:33.740538 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmh7j"] Jun 06 16:52:33.742976 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:52:33.742947 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7289393_072f_4fa7_98ea_dcb6eb7c9614.slice/crio-539702f799318d482a5d4693d0c1c4c52fece278cc2aad139318dd2d727eb226 WatchSource:0}: Error finding container 539702f799318d482a5d4693d0c1c4c52fece278cc2aad139318dd2d727eb226: Status 404 returned error can't find the container with id 539702f799318d482a5d4693d0c1c4c52fece278cc2aad139318dd2d727eb226 Jun 06 16:52:34.021063 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:34.020979 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmh7j" event={"ID":"f7289393-072f-4fa7-98ea-dcb6eb7c9614","Type":"ContainerStarted","Data":"539702f799318d482a5d4693d0c1c4c52fece278cc2aad139318dd2d727eb226"} Jun 06 16:52:36.030489 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:36.030455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmh7j" event={"ID":"f7289393-072f-4fa7-98ea-dcb6eb7c9614","Type":"ContainerStarted","Data":"f81d4c7547be3a160eb8882c24da2477255eac03edda68053c02368790cbdb73"} Jun 06 16:52:36.030848 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:36.030505 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmh7j" event={"ID":"f7289393-072f-4fa7-98ea-dcb6eb7c9614","Type":"ContainerStarted","Data":"f67663daf72f50f4fdc86360d56dfd3a0dcbb32f5161cb13da909d4f338bfc26"} Jun 06 16:52:36.030848 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:36.030535 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bmh7j" Jun 06 16:52:36.048929 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:36.048883 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bmh7j" podStartSLOduration=251.339520087 podStartE2EDuration="4m13.048865928s" totalImagesPullingTime="1.709345841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:52:36.04670077 +0000 UTC m=+287.479538302" watchObservedRunningTime="2026-06-06 16:52:36.048865928 +0000 UTC m=+287.481703458" Jun 06 16:52:37.837358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:37.837332 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:52:42.851661 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:42.851617 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" podUID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerName="registry" containerID="cri-o://099c80e38cfc484b3adb07164b173fc1ed40c1d62d21083f83b128a4a5a530ec" gracePeriod=30 Jun 06 16:52:44.060069 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:44.060031 2572 generic.go:356] "Generic (PLEG): container finished" podID="b23647cf-9dfa-4cf6-8b07-e205e4612659" containerID="099c80e38cfc484b3adb07164b173fc1ed40c1d62d21083f83b128a4a5a530ec" exitCode=0 Jun 06 16:52:44.060457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:44.060127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" event={"ID":"b23647cf-9dfa-4cf6-8b07-e205e4612659","Type":"ContainerDied","Data":"099c80e38cfc484b3adb07164b173fc1ed40c1d62d21083f83b128a4a5a530ec"} Jun 06 16:52:44.060457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:44.060183 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:52:44.060457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:44.060198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" event={"ID":"b23647cf-9dfa-4cf6-8b07-e205e4612659","Type":"ContainerStarted","Data":"e143dd1603bce982131bd6ccd452eb1747f89595d52033128e9a2d40f3289715"} Jun 06 16:52:46.035675 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:46.035646 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bmh7j" Jun 06 16:52:46.380063 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:46.379986 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmh7j_f7289393-072f-4fa7-98ea-dcb6eb7c9614/dns/0.log" Jun 06 16:52:46.579621 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:46.579592 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmh7j_f7289393-072f-4fa7-98ea-dcb6eb7c9614/kube-rbac-proxy/0.log" Jun 06 16:52:47.179365 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:47.179330 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96bcr_c9bedaf8-c988-4514-b190-1cce9f971446/dns-node-resolver/0.log" Jun 06 16:52:47.979653 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:47.979621 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-787c4494db-gnp2r_b23647cf-9dfa-4cf6-8b07-e205e4612659/registry/0.log" Jun 06 16:52:48.179479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:48.179424 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-787c4494db-gnp2r_b23647cf-9dfa-4cf6-8b07-e205e4612659/registry/1.log" Jun 06 16:52:48.378294 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:48.378266 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bshh4_bb76a589-8bc2-4d18-9930-a9faaf997801/node-ca/0.log" Jun 06 16:52:48.960283 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:48.960256 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:52:48.960967 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:48.960944 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:52:48.967395 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:48.967378 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 16:52:49.379375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:49.379350 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vqmt_854d87df-39cd-4497-9d16-f4939fff2982/serve-healthcheck-canary/0.log" Jun 06 16:52:57.965740 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:57.965689 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9ff86c476-w2r27" podUID="e308451d-76ef-451b-8491-d6bdb044c849" containerName="console" containerID="cri-o://45b4543888b5933402f70fff5b1aceb4f667d373c1f0ef10e87a92f14733500d" gracePeriod=15 Jun 06 16:52:58.116110 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.115959 2572 generic.go:356] "Generic (PLEG): container finished" podID="e308451d-76ef-451b-8491-d6bdb044c849" containerID="45b4543888b5933402f70fff5b1aceb4f667d373c1f0ef10e87a92f14733500d" exitCode=0 Jun 06 16:52:58.116110 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.116070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff86c476-w2r27" event={"ID":"e308451d-76ef-451b-8491-d6bdb044c849","Type":"ContainerDied","Data":"45b4543888b5933402f70fff5b1aceb4f667d373c1f0ef10e87a92f14733500d"} Jun 06 16:52:58.234392 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.234365 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:58.342674 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.342641 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-console-config\") pod \"e308451d-76ef-451b-8491-d6bdb044c849\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " Jun 06 16:52:58.342850 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.342699 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-oauth-config\") pod \"e308451d-76ef-451b-8491-d6bdb044c849\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " Jun 06 16:52:58.342850 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.342729 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mswlc\" (UniqueName: \"kubernetes.io/projected/e308451d-76ef-451b-8491-d6bdb044c849-kube-api-access-mswlc\") pod \"e308451d-76ef-451b-8491-d6bdb044c849\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " Jun 06 16:52:58.342850 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.342766 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-service-ca\") pod \"e308451d-76ef-451b-8491-d6bdb044c849\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " Jun 06 16:52:58.343021 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.342854 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-serving-cert\") pod \"e308451d-76ef-451b-8491-d6bdb044c849\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " Jun 06 16:52:58.343021 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.342888 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-oauth-serving-cert\") pod \"e308451d-76ef-451b-8491-d6bdb044c849\" (UID: \"e308451d-76ef-451b-8491-d6bdb044c849\") " Jun 06 16:52:58.343117 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.343056 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-console-config" (OuterVolumeSpecName: "console-config") pod "e308451d-76ef-451b-8491-d6bdb044c849" (UID: "e308451d-76ef-451b-8491-d6bdb044c849"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:52:58.343239 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.343210 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-service-ca" (OuterVolumeSpecName: "service-ca") pod "e308451d-76ef-451b-8491-d6bdb044c849" (UID: "e308451d-76ef-451b-8491-d6bdb044c849"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:52:58.343288 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.343248 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e308451d-76ef-451b-8491-d6bdb044c849" (UID: "e308451d-76ef-451b-8491-d6bdb044c849"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:52:58.345191 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.345166 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e308451d-76ef-451b-8491-d6bdb044c849-kube-api-access-mswlc" (OuterVolumeSpecName: "kube-api-access-mswlc") pod "e308451d-76ef-451b-8491-d6bdb044c849" (UID: "e308451d-76ef-451b-8491-d6bdb044c849"). InnerVolumeSpecName "kube-api-access-mswlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:52:58.345320 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.345301 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e308451d-76ef-451b-8491-d6bdb044c849" (UID: "e308451d-76ef-451b-8491-d6bdb044c849"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:52:58.345375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.345323 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e308451d-76ef-451b-8491-d6bdb044c849" (UID: "e308451d-76ef-451b-8491-d6bdb044c849"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:52:58.443577 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.443545 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:58.443577 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.443574 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:58.443577 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.443584 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:58.443793 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.443592 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e308451d-76ef-451b-8491-d6bdb044c849-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:58.443793 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.443601 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mswlc\" (UniqueName: \"kubernetes.io/projected/e308451d-76ef-451b-8491-d6bdb044c849-kube-api-access-mswlc\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:58.443793 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:58.443609 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e308451d-76ef-451b-8491-d6bdb044c849-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:52:59.120515 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:59.120475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff86c476-w2r27" event={"ID":"e308451d-76ef-451b-8491-d6bdb044c849","Type":"ContainerDied","Data":"1e19bfede8ffd5a30ab96dc680b9caf896e6a1160faea7ae0bd5ccdf857bc609"} Jun 06 16:52:59.120515 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:59.120501 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff86c476-w2r27" Jun 06 16:52:59.120969 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:59.120542 2572 scope.go:117] "RemoveContainer" containerID="45b4543888b5933402f70fff5b1aceb4f667d373c1f0ef10e87a92f14733500d" Jun 06 16:52:59.136609 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:59.136583 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9ff86c476-w2r27"] Jun 06 16:52:59.139423 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:52:59.139400 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9ff86c476-w2r27"] Jun 06 16:53:01.009780 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:01.009746 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e308451d-76ef-451b-8491-d6bdb044c849" path="/var/lib/kubelet/pods/e308451d-76ef-451b-8491-d6bdb044c849/volumes" Jun 06 16:53:05.068098 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:05.068066 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-787c4494db-gnp2r" Jun 06 16:53:07.796586 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.796551 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-977cb4dc-rh6x4"] Jun 06 16:53:07.796948 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.796827 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e308451d-76ef-451b-8491-d6bdb044c849" containerName="console" Jun 06 16:53:07.796948 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.796839 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e308451d-76ef-451b-8491-d6bdb044c849" containerName="console" Jun 06 16:53:07.796948 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.796895 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e308451d-76ef-451b-8491-d6bdb044c849" containerName="console" Jun 06 16:53:07.800513 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.800494 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.812861 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.812831 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-977cb4dc-rh6x4"] Jun 06 16:53:07.912065 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-config\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.912065 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-oauth-serving-cert\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.912309 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-trusted-ca-bundle\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.912309 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-serving-cert\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.912309 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-oauth-config\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.912309 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-service-ca\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:07.912309 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:07.912236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptbxl\" (UniqueName: \"kubernetes.io/projected/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-kube-api-access-ptbxl\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013134 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013094 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-config\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013134 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-oauth-serving-cert\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013391 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-trusted-ca-bundle\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013391 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-serving-cert\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013391 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-oauth-config\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013391 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013241 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-service-ca\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013391 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptbxl\" (UniqueName: \"kubernetes.io/projected/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-kube-api-access-ptbxl\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.013988 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.013953 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-config\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.014085 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.014029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-oauth-serving-cert\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.014085 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.014043 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-service-ca\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.014085 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.014059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-trusted-ca-bundle\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.016312 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.016275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-serving-cert\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.017782 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.017757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-oauth-config\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.021473 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.021425 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptbxl\" (UniqueName: \"kubernetes.io/projected/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-kube-api-access-ptbxl\") pod \"console-977cb4dc-rh6x4\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.112579 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.112468 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:08.241051 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:08.241006 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-977cb4dc-rh6x4"] Jun 06 16:53:09.159246 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:09.159211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-977cb4dc-rh6x4" event={"ID":"6e1cef7e-9f96-4815-b3db-b4a8e02e1015","Type":"ContainerStarted","Data":"a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6"} Jun 06 16:53:09.159661 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:09.159262 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-977cb4dc-rh6x4" event={"ID":"6e1cef7e-9f96-4815-b3db-b4a8e02e1015","Type":"ContainerStarted","Data":"4e21eff4055080864e10f30d68a4e923c1d5048a426324a0f666c72dce76b3ac"} Jun 06 16:53:09.177100 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:09.177048 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-977cb4dc-rh6x4" podStartSLOduration=2.177032815 podStartE2EDuration="2.177032815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:53:09.17460905 +0000 UTC m=+320.607446583" watchObservedRunningTime="2026-06-06 16:53:09.177032815 +0000 UTC m=+320.609870346" Jun 06 16:53:18.113065 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:18.113021 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:18.113551 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:18.113096 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:18.118730 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:18.118703 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:18.198203 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:18.198174 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:53:18.244602 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:18.244566 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766fbb4fb-wr7d2"] Jun 06 16:53:43.263936 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.263826 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-766fbb4fb-wr7d2" podUID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" containerName="console" containerID="cri-o://fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474" gracePeriod=15 Jun 06 16:53:43.504877 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.504853 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:53:43.606220 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606132 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dfkc\" (UniqueName: \"kubernetes.io/projected/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-kube-api-access-2dfkc\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606220 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606179 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-service-ca\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606220 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606212 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-trusted-ca-bundle\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606521 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606261 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-oauth-serving-cert\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606521 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606297 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-serving-cert\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606521 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606362 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-oauth-config\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606521 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606392 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-config\") pod \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\" (UID: \"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918\") " Jun 06 16:53:43.606727 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606648 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:43.606727 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606646 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:43.606727 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606703 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:43.606911 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.606891 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-config" (OuterVolumeSpecName: "console-config") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:53:43.608487 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.608458 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:43.608487 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.608464 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-kube-api-access-2dfkc" (OuterVolumeSpecName: "kube-api-access-2dfkc") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "kube-api-access-2dfkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:53:43.608631 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.608571 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" (UID: "d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:53:43.706911 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706876 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:43.706911 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706905 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-trusted-ca-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:43.706911 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706915 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:43.706911 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706923 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:43.707167 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706932 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:43.707167 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706940 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:43.707167 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:43.706947 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dfkc\" (UniqueName: \"kubernetes.io/projected/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918-kube-api-access-2dfkc\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:53:44.294645 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.294604 2572 generic.go:356] "Generic (PLEG): container finished" podID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" containerID="fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474" exitCode=0 Jun 06 16:53:44.295056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.294651 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766fbb4fb-wr7d2" Jun 06 16:53:44.295056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.294679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766fbb4fb-wr7d2" event={"ID":"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918","Type":"ContainerDied","Data":"fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474"} Jun 06 16:53:44.295056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.294722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766fbb4fb-wr7d2" event={"ID":"d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918","Type":"ContainerDied","Data":"584968eb114455b889b75e5e72619f02ed0d4bba6b469a27dad0d5a155cc46fb"} Jun 06 16:53:44.295056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.294744 2572 scope.go:117] "RemoveContainer" containerID="fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474" Jun 06 16:53:44.302956 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.302938 2572 scope.go:117] "RemoveContainer" containerID="fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474" Jun 06 16:53:44.303202 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:53:44.303184 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474\": container with ID starting with fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474 not found: ID does not exist" containerID="fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474" Jun 06 16:53:44.303239 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.303211 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474"} err="failed to get container status \"fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474\": rpc error: code = NotFound desc = could not find container \"fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474\": container with ID starting with fd2dcdf4c93d3e66ad235221340d40b5e979546ee8f3e7a36e399edffb98c474 not found: ID does not exist" Jun 06 16:53:44.313772 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.313744 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766fbb4fb-wr7d2"] Jun 06 16:53:44.317448 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:44.317414 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766fbb4fb-wr7d2"] Jun 06 16:53:45.009565 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:53:45.009534 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" path="/var/lib/kubelet/pods/d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918/volumes" Jun 06 16:54:53.951967 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.951934 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4"] Jun 06 16:54:53.952388 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.952183 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" containerName="console" Jun 06 16:54:53.952388 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.952194 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" containerName="console" Jun 06 16:54:53.952388 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.952265 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6bffa62-2d3e-4d1b-afb6-b8bd9ecea918" containerName="console" Jun 06 16:54:53.955268 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.955251 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:53.957786 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.957767 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 16:54:53.957864 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.957767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wnlgj\"" Jun 06 16:54:53.958918 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.958906 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 16:54:53.964346 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:53.964326 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4"] Jun 06 16:54:54.055170 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.055134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.055170 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.055174 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rnk\" (UniqueName: \"kubernetes.io/projected/2e4d31a5-4811-43f2-ada3-a58166478132-kube-api-access-95rnk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.055402 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.055201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.155824 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.155784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95rnk\" (UniqueName: \"kubernetes.io/projected/2e4d31a5-4811-43f2-ada3-a58166478132-kube-api-access-95rnk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.156003 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.155836 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.156003 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.155938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.156300 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.156279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.156338 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.156313 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.163765 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.163739 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rnk\" (UniqueName: \"kubernetes.io/projected/2e4d31a5-4811-43f2-ada3-a58166478132-kube-api-access-95rnk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.264559 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.264526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:54:54.388589 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.388555 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4"] Jun 06 16:54:54.391365 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:54:54.391330 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4d31a5_4811_43f2_ada3_a58166478132.slice/crio-065e80a12c5a9d1c08fc8cccabdd404fd05a87874074616dba605ce60403cbab WatchSource:0}: Error finding container 065e80a12c5a9d1c08fc8cccabdd404fd05a87874074616dba605ce60403cbab: Status 404 returned error can't find the container with id 065e80a12c5a9d1c08fc8cccabdd404fd05a87874074616dba605ce60403cbab Jun 06 16:54:54.393251 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.393235 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 16:54:54.547429 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:54:54.547335 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" event={"ID":"2e4d31a5-4811-43f2-ada3-a58166478132","Type":"ContainerStarted","Data":"065e80a12c5a9d1c08fc8cccabdd404fd05a87874074616dba605ce60403cbab"} Jun 06 16:55:00.571195 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:00.571158 2572 generic.go:356] "Generic (PLEG): container finished" podID="2e4d31a5-4811-43f2-ada3-a58166478132" containerID="926c1de8c587f225fcc98c20e420fca0a16b5cd2688e5676d64e9268806d518c" exitCode=0 Jun 06 16:55:00.571736 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:00.571244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" event={"ID":"2e4d31a5-4811-43f2-ada3-a58166478132","Type":"ContainerDied","Data":"926c1de8c587f225fcc98c20e420fca0a16b5cd2688e5676d64e9268806d518c"} Jun 06 16:55:05.409895 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.409858 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-hn7s9"] Jun 06 16:55:05.414377 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.414357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.416925 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.416899 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 16:55:05.417028 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.416953 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 16:55:05.418238 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.418217 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b5vdp\"" Jun 06 16:55:05.420499 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.420476 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-hn7s9"] Jun 06 16:55:05.438929 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.438898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx82d\" (UniqueName: \"kubernetes.io/projected/75101c5f-5e4e-4379-9dd3-381775036ca3-kube-api-access-kx82d\") pod \"cert-manager-59c77684cc-hn7s9\" (UID: \"75101c5f-5e4e-4379-9dd3-381775036ca3\") " pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.439083 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.438948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75101c5f-5e4e-4379-9dd3-381775036ca3-bound-sa-token\") pod \"cert-manager-59c77684cc-hn7s9\" (UID: \"75101c5f-5e4e-4379-9dd3-381775036ca3\") " pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.539950 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.539906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx82d\" (UniqueName: \"kubernetes.io/projected/75101c5f-5e4e-4379-9dd3-381775036ca3-kube-api-access-kx82d\") pod \"cert-manager-59c77684cc-hn7s9\" (UID: \"75101c5f-5e4e-4379-9dd3-381775036ca3\") " pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.540132 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.539971 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75101c5f-5e4e-4379-9dd3-381775036ca3-bound-sa-token\") pod \"cert-manager-59c77684cc-hn7s9\" (UID: \"75101c5f-5e4e-4379-9dd3-381775036ca3\") " pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.547735 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.547704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75101c5f-5e4e-4379-9dd3-381775036ca3-bound-sa-token\") pod \"cert-manager-59c77684cc-hn7s9\" (UID: \"75101c5f-5e4e-4379-9dd3-381775036ca3\") " pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.547735 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.547731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx82d\" (UniqueName: \"kubernetes.io/projected/75101c5f-5e4e-4379-9dd3-381775036ca3-kube-api-access-kx82d\") pod \"cert-manager-59c77684cc-hn7s9\" (UID: \"75101c5f-5e4e-4379-9dd3-381775036ca3\") " pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.724642 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.724551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-hn7s9" Jun 06 16:55:05.873122 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:05.873097 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-hn7s9"] Jun 06 16:55:05.876304 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:55:05.876273 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75101c5f_5e4e_4379_9dd3_381775036ca3.slice/crio-9d97311e15aa2ddc8f51cf771f3bae5a6191d6478720c108e781e2be0144fbfb WatchSource:0}: Error finding container 9d97311e15aa2ddc8f51cf771f3bae5a6191d6478720c108e781e2be0144fbfb: Status 404 returned error can't find the container with id 9d97311e15aa2ddc8f51cf771f3bae5a6191d6478720c108e781e2be0144fbfb Jun 06 16:55:06.594698 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:06.594661 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-hn7s9" event={"ID":"75101c5f-5e4e-4379-9dd3-381775036ca3","Type":"ContainerStarted","Data":"9d97311e15aa2ddc8f51cf771f3bae5a6191d6478720c108e781e2be0144fbfb"} Jun 06 16:55:07.601056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:07.600926 2572 generic.go:356] "Generic (PLEG): container finished" podID="2e4d31a5-4811-43f2-ada3-a58166478132" containerID="94f9fd7014908122a77cda755900dd11a306fb317265fe0bb8e2f7c4f8db12a8" exitCode=0 Jun 06 16:55:07.601056 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:07.601034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" event={"ID":"2e4d31a5-4811-43f2-ada3-a58166478132","Type":"ContainerDied","Data":"94f9fd7014908122a77cda755900dd11a306fb317265fe0bb8e2f7c4f8db12a8"} Jun 06 16:55:09.612270 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:09.612231 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-hn7s9" event={"ID":"75101c5f-5e4e-4379-9dd3-381775036ca3","Type":"ContainerStarted","Data":"d9a3c0f49986cafd28a8d50ea5a1ad4ceff0f433674a2f428ff76259376aaaf8"} Jun 06 16:55:09.629099 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:09.629042 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-hn7s9" podStartSLOduration=1.312637283 podStartE2EDuration="4.629021125s" totalImagesPullingTime="3.316383842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:55:09.626917071 +0000 UTC m=+441.059754603" watchObservedRunningTime="2026-06-06 16:55:09.629021125 +0000 UTC m=+441.061858660" Jun 06 16:55:14.635166 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:14.635126 2572 generic.go:356] "Generic (PLEG): container finished" podID="2e4d31a5-4811-43f2-ada3-a58166478132" containerID="40791e3d814684605014c88a2c7e57ec3258b9159f74c66748bcc23844899da1" exitCode=0 Jun 06 16:55:14.635563 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:14.635198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" event={"ID":"2e4d31a5-4811-43f2-ada3-a58166478132","Type":"ContainerDied","Data":"40791e3d814684605014c88a2c7e57ec3258b9159f74c66748bcc23844899da1"} Jun 06 16:55:15.764171 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.764141 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:55:15.831205 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.831148 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-bundle\") pod \"2e4d31a5-4811-43f2-ada3-a58166478132\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " Jun 06 16:55:15.831205 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.831218 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95rnk\" (UniqueName: \"kubernetes.io/projected/2e4d31a5-4811-43f2-ada3-a58166478132-kube-api-access-95rnk\") pod \"2e4d31a5-4811-43f2-ada3-a58166478132\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " Jun 06 16:55:15.831489 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.831267 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-util\") pod \"2e4d31a5-4811-43f2-ada3-a58166478132\" (UID: \"2e4d31a5-4811-43f2-ada3-a58166478132\") " Jun 06 16:55:15.831658 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.831630 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-bundle" (OuterVolumeSpecName: "bundle") pod "2e4d31a5-4811-43f2-ada3-a58166478132" (UID: "2e4d31a5-4811-43f2-ada3-a58166478132"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:55:15.833419 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.833392 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4d31a5-4811-43f2-ada3-a58166478132-kube-api-access-95rnk" (OuterVolumeSpecName: "kube-api-access-95rnk") pod "2e4d31a5-4811-43f2-ada3-a58166478132" (UID: "2e4d31a5-4811-43f2-ada3-a58166478132"). InnerVolumeSpecName "kube-api-access-95rnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:55:15.837589 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.837563 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-util" (OuterVolumeSpecName: "util") pod "2e4d31a5-4811-43f2-ada3-a58166478132" (UID: "2e4d31a5-4811-43f2-ada3-a58166478132"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:55:15.932097 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.931996 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-util\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:55:15.932097 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.932042 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4d31a5-4811-43f2-ada3-a58166478132-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:55:15.932097 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:15.932051 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95rnk\" (UniqueName: \"kubernetes.io/projected/2e4d31a5-4811-43f2-ada3-a58166478132-kube-api-access-95rnk\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:55:16.644931 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:16.644890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" event={"ID":"2e4d31a5-4811-43f2-ada3-a58166478132","Type":"ContainerDied","Data":"065e80a12c5a9d1c08fc8cccabdd404fd05a87874074616dba605ce60403cbab"} Jun 06 16:55:16.644931 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:16.644924 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4s4n4" Jun 06 16:55:16.645185 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:16.644946 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="065e80a12c5a9d1c08fc8cccabdd404fd05a87874074616dba605ce60403cbab" Jun 06 16:55:22.178006 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.177971 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk"] Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178249 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="pull" Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178259 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="pull" Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178271 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="util" Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178277 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="util" Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178288 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="extract" Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178294 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="extract" Jun 06 16:55:22.178381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.178344 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e4d31a5-4811-43f2-ada3-a58166478132" containerName="extract" Jun 06 16:55:22.181270 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.181253 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.183887 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.183866 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 16:55:22.184016 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.183885 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 16:55:22.185021 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.184999 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ktb56\"" Jun 06 16:55:22.188579 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.188560 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk"] Jun 06 16:55:22.278274 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.278239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87nxw\" (UniqueName: \"kubernetes.io/projected/d7c6e40a-136a-4a77-80f5-68013a3a9e42-kube-api-access-87nxw\") pod \"openshift-lws-operator-fd8ccff4c-ndlzk\" (UID: \"d7c6e40a-136a-4a77-80f5-68013a3a9e42\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.278459 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.278308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7c6e40a-136a-4a77-80f5-68013a3a9e42-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ndlzk\" (UID: \"d7c6e40a-136a-4a77-80f5-68013a3a9e42\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.379323 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.379276 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7c6e40a-136a-4a77-80f5-68013a3a9e42-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ndlzk\" (UID: \"d7c6e40a-136a-4a77-80f5-68013a3a9e42\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.379323 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.379333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87nxw\" (UniqueName: \"kubernetes.io/projected/d7c6e40a-136a-4a77-80f5-68013a3a9e42-kube-api-access-87nxw\") pod \"openshift-lws-operator-fd8ccff4c-ndlzk\" (UID: \"d7c6e40a-136a-4a77-80f5-68013a3a9e42\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.379690 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.379670 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7c6e40a-136a-4a77-80f5-68013a3a9e42-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ndlzk\" (UID: \"d7c6e40a-136a-4a77-80f5-68013a3a9e42\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.387588 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.387563 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87nxw\" (UniqueName: \"kubernetes.io/projected/d7c6e40a-136a-4a77-80f5-68013a3a9e42-kube-api-access-87nxw\") pod \"openshift-lws-operator-fd8ccff4c-ndlzk\" (UID: \"d7c6e40a-136a-4a77-80f5-68013a3a9e42\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.490996 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.490960 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" Jun 06 16:55:22.617922 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.617893 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk"] Jun 06 16:55:22.620674 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:55:22.620650 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7c6e40a_136a_4a77_80f5_68013a3a9e42.slice/crio-84270208518c4e38e75f764a8881a0fd2ac9d59547e4edd281fe83eeead66c4b WatchSource:0}: Error finding container 84270208518c4e38e75f764a8881a0fd2ac9d59547e4edd281fe83eeead66c4b: Status 404 returned error can't find the container with id 84270208518c4e38e75f764a8881a0fd2ac9d59547e4edd281fe83eeead66c4b Jun 06 16:55:22.668629 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:22.668582 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" event={"ID":"d7c6e40a-136a-4a77-80f5-68013a3a9e42","Type":"ContainerStarted","Data":"84270208518c4e38e75f764a8881a0fd2ac9d59547e4edd281fe83eeead66c4b"} Jun 06 16:55:24.680668 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:24.680567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" event={"ID":"d7c6e40a-136a-4a77-80f5-68013a3a9e42","Type":"ContainerStarted","Data":"20bf5b0c64c36cf803023eaf8a18368e81b055f18d97e1a5c9007ef2851c9c05"} Jun 06 16:55:24.696773 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:24.696708 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ndlzk" podStartSLOduration=0.910223547 podStartE2EDuration="2.696688566s" totalImagesPullingTime="1.786465019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:55:24.695126178 +0000 UTC m=+456.127963712" watchObservedRunningTime="2026-06-06 16:55:24.696688566 +0000 UTC m=+456.129526099" Jun 06 16:55:27.477343 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.477265 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn"] Jun 06 16:55:27.480709 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.480692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.483337 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.483302 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wnlgj\"" Jun 06 16:55:27.483337 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.483313 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 16:55:27.483495 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.483355 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 16:55:27.488286 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.488260 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn"] Jun 06 16:55:27.522532 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.522500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.522687 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.522550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfhc\" (UniqueName: \"kubernetes.io/projected/de73643b-b24f-43c4-9275-f47705e59c13-kube-api-access-rkfhc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.522687 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.522571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.623823 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.623782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfhc\" (UniqueName: \"kubernetes.io/projected/de73643b-b24f-43c4-9275-f47705e59c13-kube-api-access-rkfhc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.623823 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.623820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.624018 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.623869 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.624323 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.624303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.624323 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.624315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.631823 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.631796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfhc\" (UniqueName: \"kubernetes.io/projected/de73643b-b24f-43c4-9275-f47705e59c13-kube-api-access-rkfhc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.789932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.789902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:27.918031 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:27.918007 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn"] Jun 06 16:55:27.920402 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:55:27.920370 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde73643b_b24f_43c4_9275_f47705e59c13.slice/crio-afb5e0b685628b7953d4baa7f1ef5daf55263f97199148e15ddf792096db2d7a WatchSource:0}: Error finding container afb5e0b685628b7953d4baa7f1ef5daf55263f97199148e15ddf792096db2d7a: Status 404 returned error can't find the container with id afb5e0b685628b7953d4baa7f1ef5daf55263f97199148e15ddf792096db2d7a Jun 06 16:55:28.696136 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:28.696097 2572 generic.go:356] "Generic (PLEG): container finished" podID="de73643b-b24f-43c4-9275-f47705e59c13" containerID="e77b2448f7d3a7991340db30e19a48ee9804753968d0268ca3d4a3bc2f1ba587" exitCode=0 Jun 06 16:55:28.696539 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:28.696148 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" event={"ID":"de73643b-b24f-43c4-9275-f47705e59c13","Type":"ContainerDied","Data":"e77b2448f7d3a7991340db30e19a48ee9804753968d0268ca3d4a3bc2f1ba587"} Jun 06 16:55:28.696539 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:28.696234 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" event={"ID":"de73643b-b24f-43c4-9275-f47705e59c13","Type":"ContainerStarted","Data":"afb5e0b685628b7953d4baa7f1ef5daf55263f97199148e15ddf792096db2d7a"} Jun 06 16:55:29.701852 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:29.701814 2572 generic.go:356] "Generic (PLEG): container finished" podID="de73643b-b24f-43c4-9275-f47705e59c13" containerID="b73fcce3b1d42309f9fc16fa08bc2a6a13068e2aacf8e83d50074ff5e7445a18" exitCode=0 Jun 06 16:55:29.701852 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:29.701852 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" event={"ID":"de73643b-b24f-43c4-9275-f47705e59c13","Type":"ContainerDied","Data":"b73fcce3b1d42309f9fc16fa08bc2a6a13068e2aacf8e83d50074ff5e7445a18"} Jun 06 16:55:30.707899 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:30.707857 2572 generic.go:356] "Generic (PLEG): container finished" podID="de73643b-b24f-43c4-9275-f47705e59c13" containerID="9233fda7151f27bfe496359d7062635a71d41f291a5472c3c6b18de94cf745b8" exitCode=0 Jun 06 16:55:30.708284 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:30.707943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" event={"ID":"de73643b-b24f-43c4-9275-f47705e59c13","Type":"ContainerDied","Data":"9233fda7151f27bfe496359d7062635a71d41f291a5472c3c6b18de94cf745b8"} Jun 06 16:55:31.836343 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.836312 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:31.957737 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.957700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-bundle\") pod \"de73643b-b24f-43c4-9275-f47705e59c13\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " Jun 06 16:55:31.957902 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.957854 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkfhc\" (UniqueName: \"kubernetes.io/projected/de73643b-b24f-43c4-9275-f47705e59c13-kube-api-access-rkfhc\") pod \"de73643b-b24f-43c4-9275-f47705e59c13\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " Jun 06 16:55:31.957902 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.957887 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-util\") pod \"de73643b-b24f-43c4-9275-f47705e59c13\" (UID: \"de73643b-b24f-43c4-9275-f47705e59c13\") " Jun 06 16:55:31.958542 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.958509 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-bundle" (OuterVolumeSpecName: "bundle") pod "de73643b-b24f-43c4-9275-f47705e59c13" (UID: "de73643b-b24f-43c4-9275-f47705e59c13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:55:31.959985 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.959954 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de73643b-b24f-43c4-9275-f47705e59c13-kube-api-access-rkfhc" (OuterVolumeSpecName: "kube-api-access-rkfhc") pod "de73643b-b24f-43c4-9275-f47705e59c13" (UID: "de73643b-b24f-43c4-9275-f47705e59c13"). InnerVolumeSpecName "kube-api-access-rkfhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:55:31.962808 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:31.962761 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-util" (OuterVolumeSpecName: "util") pod "de73643b-b24f-43c4-9275-f47705e59c13" (UID: "de73643b-b24f-43c4-9275-f47705e59c13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:55:32.058991 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:32.058951 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkfhc\" (UniqueName: \"kubernetes.io/projected/de73643b-b24f-43c4-9275-f47705e59c13-kube-api-access-rkfhc\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:55:32.058991 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:32.058980 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-util\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:55:32.058991 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:32.058989 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de73643b-b24f-43c4-9275-f47705e59c13-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:55:32.718077 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:32.718037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" event={"ID":"de73643b-b24f-43c4-9275-f47705e59c13","Type":"ContainerDied","Data":"afb5e0b685628b7953d4baa7f1ef5daf55263f97199148e15ddf792096db2d7a"} Jun 06 16:55:32.718243 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:32.718084 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxdcn" Jun 06 16:55:32.718243 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:32.718093 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afb5e0b685628b7953d4baa7f1ef5daf55263f97199148e15ddf792096db2d7a" Jun 06 16:55:44.412230 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412189 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9"] Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412542 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="pull" Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412558 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="pull" Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412582 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="util" Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412590 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="util" Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412603 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="extract" Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412609 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="extract" Jun 06 16:55:44.412710 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.412664 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="de73643b-b24f-43c4-9275-f47705e59c13" containerName="extract" Jun 06 16:55:44.416554 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.416536 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.419370 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.419338 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 16:55:44.419502 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.419396 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 16:55:44.419502 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.419414 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 16:55:44.419502 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.419414 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ld5z5\"" Jun 06 16:55:44.419663 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.419650 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 16:55:44.429751 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.429725 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9"] Jun 06 16:55:44.557553 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.557465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c764fdba-10a8-452d-93d8-d10ead7ebcfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.557553 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.557507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c764fdba-10a8-452d-93d8-d10ead7ebcfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.557553 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.557555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c764fdba-10a8-452d-93d8-d10ead7ebcfd-tmp\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.557802 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.557577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c764fdba-10a8-452d-93d8-d10ead7ebcfd-manifests\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.557802 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.557598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjqhh\" (UniqueName: \"kubernetes.io/projected/c764fdba-10a8-452d-93d8-d10ead7ebcfd-kube-api-access-cjqhh\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.658464 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.658412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c764fdba-10a8-452d-93d8-d10ead7ebcfd-manifests\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.658464 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.658467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqhh\" (UniqueName: \"kubernetes.io/projected/c764fdba-10a8-452d-93d8-d10ead7ebcfd-kube-api-access-cjqhh\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.658716 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.658543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c764fdba-10a8-452d-93d8-d10ead7ebcfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.658716 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.658571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c764fdba-10a8-452d-93d8-d10ead7ebcfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.658716 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.658614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c764fdba-10a8-452d-93d8-d10ead7ebcfd-tmp\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.658923 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.658901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c764fdba-10a8-452d-93d8-d10ead7ebcfd-manifests\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.660889 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.660851 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c764fdba-10a8-452d-93d8-d10ead7ebcfd-tmp\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.661145 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.661125 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c764fdba-10a8-452d-93d8-d10ead7ebcfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.661219 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.661130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c764fdba-10a8-452d-93d8-d10ead7ebcfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.668796 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.668740 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjqhh\" (UniqueName: \"kubernetes.io/projected/c764fdba-10a8-452d-93d8-d10ead7ebcfd-kube-api-access-cjqhh\") pod \"opendatahub-operator-controller-manager-86bd68968c-zzjb9\" (UID: \"c764fdba-10a8-452d-93d8-d10ead7ebcfd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.727102 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.727071 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:44.861730 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:44.861706 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9"] Jun 06 16:55:44.863959 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:55:44.863931 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc764fdba_10a8_452d_93d8_d10ead7ebcfd.slice/crio-8a34f5e5775974dcf640a59526479f6045200eb44d1fdb3ed751cdf54197b267 WatchSource:0}: Error finding container 8a34f5e5775974dcf640a59526479f6045200eb44d1fdb3ed751cdf54197b267: Status 404 returned error can't find the container with id 8a34f5e5775974dcf640a59526479f6045200eb44d1fdb3ed751cdf54197b267 Jun 06 16:55:45.775077 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:45.775034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" event={"ID":"c764fdba-10a8-452d-93d8-d10ead7ebcfd","Type":"ContainerStarted","Data":"8a34f5e5775974dcf640a59526479f6045200eb44d1fdb3ed751cdf54197b267"} Jun 06 16:55:48.790898 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:48.790863 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" event={"ID":"c764fdba-10a8-452d-93d8-d10ead7ebcfd","Type":"ContainerStarted","Data":"297a91fb2bf7c2bc3886b5556288c8de5344d66b4c144c3f82cd6526845d5fbf"} Jun 06 16:55:49.796822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:49.796787 2572 generic.go:356] "Generic (PLEG): container finished" podID="c764fdba-10a8-452d-93d8-d10ead7ebcfd" containerID="297a91fb2bf7c2bc3886b5556288c8de5344d66b4c144c3f82cd6526845d5fbf" exitCode=0 Jun 06 16:55:49.797205 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:49.796870 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" event={"ID":"c764fdba-10a8-452d-93d8-d10ead7ebcfd","Type":"ContainerDied","Data":"297a91fb2bf7c2bc3886b5556288c8de5344d66b4c144c3f82cd6526845d5fbf"} Jun 06 16:55:50.802929 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:50.802886 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" event={"ID":"c764fdba-10a8-452d-93d8-d10ead7ebcfd","Type":"ContainerStarted","Data":"5970cd88c0655ee01e746aed8cedf6df0d5de10fcfba59d5cf14fa0a0cd3a58e"} Jun 06 16:55:50.803370 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:50.803106 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:55:50.825198 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:55:50.825151 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" podStartSLOduration=2.110540315 podStartE2EDuration="6.825136636s" totalImagesPullingTime="3.710784609s" totalInitContainerRuntime="1.003811712s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:55:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:55:50.823676105 +0000 UTC m=+482.256513638" watchObservedRunningTime="2026-06-06 16:55:50.825136636 +0000 UTC m=+482.257974168" Jun 06 16:56:01.809705 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:01.809672 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bd68968c-zzjb9" Jun 06 16:56:03.721447 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.721400 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p"] Jun 06 16:56:03.729153 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.729125 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:03.732101 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.732075 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 16:56:03.732661 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.732635 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 06 16:56:03.732783 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.732688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 16:56:03.732783 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.732724 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vtd88\"" Jun 06 16:56:03.732783 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.732644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 06 16:56:03.732979 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.732955 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p"] Jun 06 16:56:03.887316 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.887286 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-q79j9"] Jun 06 16:56:03.890503 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.890482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:03.894958 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.894936 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 06 16:56:03.895199 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.895182 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-z2kgh\"" Jun 06 16:56:03.908845 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.908819 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-q79j9"] Jun 06 16:56:03.917816 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.917791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77316a2-462a-4545-bf96-82b3fc3e5c86-tmp\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:03.917927 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.917831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllgk\" (UniqueName: \"kubernetes.io/projected/a77316a2-462a-4545-bf96-82b3fc3e5c86-kube-api-access-bllgk\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:03.917927 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.917861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-cert\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:03.918003 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.917935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77316a2-462a-4545-bf96-82b3fc3e5c86-tls-certs\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:03.918003 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:03.917984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94rm4\" (UniqueName: \"kubernetes.io/projected/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-kube-api-access-94rm4\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.019045 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.019012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-cert\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.019241 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.019052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77316a2-462a-4545-bf96-82b3fc3e5c86-tls-certs\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.019241 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.019086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94rm4\" (UniqueName: \"kubernetes.io/projected/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-kube-api-access-94rm4\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.019241 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.019161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77316a2-462a-4545-bf96-82b3fc3e5c86-tmp\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.019241 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:56:04.019171 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 06 16:56:04.019241 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.019202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllgk\" (UniqueName: \"kubernetes.io/projected/a77316a2-462a-4545-bf96-82b3fc3e5c86-kube-api-access-bllgk\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.019503 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:56:04.019249 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-cert podName:a21a7fb1-8006-4bde-a2a6-a87ffc872ab1 nodeName:}" failed. No retries permitted until 2026-06-06 16:56:04.519227194 +0000 UTC m=+495.952064726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-cert") pod "odh-model-controller-6dc94f689f-q79j9" (UID: "a21a7fb1-8006-4bde-a2a6-a87ffc872ab1") : secret "odh-model-controller-webhook-cert" not found Jun 06 16:56:04.021415 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.021391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77316a2-462a-4545-bf96-82b3fc3e5c86-tmp\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.021639 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.021621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77316a2-462a-4545-bf96-82b3fc3e5c86-tls-certs\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.034091 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.034068 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllgk\" (UniqueName: \"kubernetes.io/projected/a77316a2-462a-4545-bf96-82b3fc3e5c86-kube-api-access-bllgk\") pod \"kube-auth-proxy-7f5b7f78f5-k2p6p\" (UID: \"a77316a2-462a-4545-bf96-82b3fc3e5c86\") " pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.034366 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.034348 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94rm4\" (UniqueName: \"kubernetes.io/projected/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-kube-api-access-94rm4\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.039446 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.039417 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" Jun 06 16:56:04.174177 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.174137 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p"] Jun 06 16:56:04.177560 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:04.177529 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77316a2_462a_4545_bf96_82b3fc3e5c86.slice/crio-27c250b4043582f5737d1211a050038438fabb6f08f8bd1a192f46a241e7d6df WatchSource:0}: Error finding container 27c250b4043582f5737d1211a050038438fabb6f08f8bd1a192f46a241e7d6df: Status 404 returned error can't find the container with id 27c250b4043582f5737d1211a050038438fabb6f08f8bd1a192f46a241e7d6df Jun 06 16:56:04.417919 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.417838 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9r5bt"] Jun 06 16:56:04.422201 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.422180 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.424865 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.424845 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 06 16:56:04.429409 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.429380 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9r5bt"] Jun 06 16:56:04.522132 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.522091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d0302b-126c-4807-8df5-bf9451a45a21-tls-certs\") pod \"model-serving-api-5dd488fc48-9r5bt\" (UID: \"a6d0302b-126c-4807-8df5-bf9451a45a21\") " pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.522132 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.522133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prrxt\" (UniqueName: \"kubernetes.io/projected/a6d0302b-126c-4807-8df5-bf9451a45a21-kube-api-access-prrxt\") pod \"model-serving-api-5dd488fc48-9r5bt\" (UID: \"a6d0302b-126c-4807-8df5-bf9451a45a21\") " pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.522393 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.522184 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-cert\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.524550 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.524528 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a21a7fb1-8006-4bde-a2a6-a87ffc872ab1-cert\") pod \"odh-model-controller-6dc94f689f-q79j9\" (UID: \"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1\") " pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.622822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.622780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d0302b-126c-4807-8df5-bf9451a45a21-tls-certs\") pod \"model-serving-api-5dd488fc48-9r5bt\" (UID: \"a6d0302b-126c-4807-8df5-bf9451a45a21\") " pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.622822 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.622827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prrxt\" (UniqueName: \"kubernetes.io/projected/a6d0302b-126c-4807-8df5-bf9451a45a21-kube-api-access-prrxt\") pod \"model-serving-api-5dd488fc48-9r5bt\" (UID: \"a6d0302b-126c-4807-8df5-bf9451a45a21\") " pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.625187 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.625168 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d0302b-126c-4807-8df5-bf9451a45a21-tls-certs\") pod \"model-serving-api-5dd488fc48-9r5bt\" (UID: \"a6d0302b-126c-4807-8df5-bf9451a45a21\") " pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.631234 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.631215 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prrxt\" (UniqueName: \"kubernetes.io/projected/a6d0302b-126c-4807-8df5-bf9451a45a21-kube-api-access-prrxt\") pod \"model-serving-api-5dd488fc48-9r5bt\" (UID: \"a6d0302b-126c-4807-8df5-bf9451a45a21\") " pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.734009 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.733860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:04.801015 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.800972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:04.869553 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.869515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" event={"ID":"a77316a2-462a-4545-bf96-82b3fc3e5c86","Type":"ContainerStarted","Data":"27c250b4043582f5737d1211a050038438fabb6f08f8bd1a192f46a241e7d6df"} Jun 06 16:56:04.902831 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.902749 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9r5bt"] Jun 06 16:56:04.906221 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:04.906176 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d0302b_126c_4807_8df5_bf9451a45a21.slice/crio-cc5981ea17a28a7af642db2b098020c9bfe1aa7d1d88c317656c3ddb2dc20113 WatchSource:0}: Error finding container cc5981ea17a28a7af642db2b098020c9bfe1aa7d1d88c317656c3ddb2dc20113: Status 404 returned error can't find the container with id cc5981ea17a28a7af642db2b098020c9bfe1aa7d1d88c317656c3ddb2dc20113 Jun 06 16:56:04.972264 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:04.972119 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-q79j9"] Jun 06 16:56:04.974868 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:04.974832 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21a7fb1_8006_4bde_a2a6_a87ffc872ab1.slice/crio-3cc889655f9fb6b88700a64d665c68f4d52a59ee8e6d02fa41ec730535895c46 WatchSource:0}: Error finding container 3cc889655f9fb6b88700a64d665c68f4d52a59ee8e6d02fa41ec730535895c46: Status 404 returned error can't find the container with id 3cc889655f9fb6b88700a64d665c68f4d52a59ee8e6d02fa41ec730535895c46 Jun 06 16:56:05.555202 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.553563 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr"] Jun 06 16:56:05.558177 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.557237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.563493 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.562607 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wnlgj\"" Jun 06 16:56:05.563493 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.562896 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 16:56:05.563493 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.563074 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 16:56:05.571932 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.570799 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr"] Jun 06 16:56:05.631238 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.631202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.631415 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.631257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.631415 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.631341 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2mg\" (UniqueName: \"kubernetes.io/projected/1558e454-9c8a-4f77-b581-077f7e79365a-kube-api-access-dg2mg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.732072 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.732033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2mg\" (UniqueName: \"kubernetes.io/projected/1558e454-9c8a-4f77-b581-077f7e79365a-kube-api-access-dg2mg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.732329 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.732127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.732329 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.732160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.732635 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.732613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.733381 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.733358 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.747202 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.747170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2mg\" (UniqueName: \"kubernetes.io/projected/1558e454-9c8a-4f77-b581-077f7e79365a-kube-api-access-dg2mg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.882868 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.882790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:05.883782 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.883746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" event={"ID":"a6d0302b-126c-4807-8df5-bf9451a45a21","Type":"ContainerStarted","Data":"cc5981ea17a28a7af642db2b098020c9bfe1aa7d1d88c317656c3ddb2dc20113"} Jun 06 16:56:05.887037 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:05.886946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" event={"ID":"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1","Type":"ContainerStarted","Data":"3cc889655f9fb6b88700a64d665c68f4d52a59ee8e6d02fa41ec730535895c46"} Jun 06 16:56:09.091592 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.091560 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr"] Jun 06 16:56:09.094362 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:09.094329 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1558e454_9c8a_4f77_b581_077f7e79365a.slice/crio-a7ccda123998a56c39fb846c602da7f231a5a76bdc9bae8f73debe7e5b98eb24 WatchSource:0}: Error finding container a7ccda123998a56c39fb846c602da7f231a5a76bdc9bae8f73debe7e5b98eb24: Status 404 returned error can't find the container with id a7ccda123998a56c39fb846c602da7f231a5a76bdc9bae8f73debe7e5b98eb24 Jun 06 16:56:09.909931 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.909898 2572 generic.go:356] "Generic (PLEG): container finished" podID="1558e454-9c8a-4f77-b581-077f7e79365a" containerID="f415bdf5907a5715ec62172689fdc6c532a4574486c9860cb9b108e8547f1fc3" exitCode=0 Jun 06 16:56:09.910148 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.909992 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" event={"ID":"1558e454-9c8a-4f77-b581-077f7e79365a","Type":"ContainerDied","Data":"f415bdf5907a5715ec62172689fdc6c532a4574486c9860cb9b108e8547f1fc3"} Jun 06 16:56:09.910148 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.910043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" event={"ID":"1558e454-9c8a-4f77-b581-077f7e79365a","Type":"ContainerStarted","Data":"a7ccda123998a56c39fb846c602da7f231a5a76bdc9bae8f73debe7e5b98eb24"} Jun 06 16:56:09.911563 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.911542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" event={"ID":"a77316a2-462a-4545-bf96-82b3fc3e5c86","Type":"ContainerStarted","Data":"78654f8adf47a79e1f8790d0a4f98142b2dfc23fe88a0023d038b9066fb49c63"} Jun 06 16:56:09.913052 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.913027 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" event={"ID":"a6d0302b-126c-4807-8df5-bf9451a45a21","Type":"ContainerStarted","Data":"65aa7d5b11cbcc537a0ee07ee66ed2212b281dc4973ff77d16f5467efd0ad038"} Jun 06 16:56:09.913150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.913097 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:09.914565 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.914542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" event={"ID":"a21a7fb1-8006-4bde-a2a6-a87ffc872ab1","Type":"ContainerStarted","Data":"1ac4a11d36755945e28e3c7a193a3201d53030ef2635ac1f48614cc37dbed825"} Jun 06 16:56:09.914692 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.914679 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:09.961287 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.961233 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f5b7f78f5-k2p6p" podStartSLOduration=2.183558035 podStartE2EDuration="6.961218033s" totalImagesPullingTime="4.777659998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:09.959527482 +0000 UTC m=+501.392365014" watchObservedRunningTime="2026-06-06 16:56:09.961218033 +0000 UTC m=+501.394055564" Jun 06 16:56:09.979147 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.979099 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" podStartSLOduration=2.957499891 podStartE2EDuration="6.979078591s" totalImagesPullingTime="4.0215787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:09.977871098 +0000 UTC m=+501.410708630" watchObservedRunningTime="2026-06-06 16:56:09.979078591 +0000 UTC m=+501.411916122" Jun 06 16:56:09.994663 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:09.994612 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" podStartSLOduration=1.945430089 podStartE2EDuration="5.99459612s" totalImagesPullingTime="4.049166031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:09.993495391 +0000 UTC m=+501.426332924" watchObservedRunningTime="2026-06-06 16:56:09.99459612 +0000 UTC m=+501.427433649" Jun 06 16:56:10.920356 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:10.920326 2572 generic.go:356] "Generic (PLEG): container finished" podID="1558e454-9c8a-4f77-b581-077f7e79365a" containerID="add84ae96ac38068cb2b1e2fe164e5fd1f28192a1bbe414d5f028517d8eb8cda" exitCode=0 Jun 06 16:56:10.920851 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:10.920727 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" event={"ID":"1558e454-9c8a-4f77-b581-077f7e79365a","Type":"ContainerDied","Data":"add84ae96ac38068cb2b1e2fe164e5fd1f28192a1bbe414d5f028517d8eb8cda"} Jun 06 16:56:11.928959 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:11.928925 2572 generic.go:356] "Generic (PLEG): container finished" podID="1558e454-9c8a-4f77-b581-077f7e79365a" containerID="1c20652b269a0f6aac4112f72f4676374fbcce7b7d8753840df1e299aecd3fa3" exitCode=0 Jun 06 16:56:11.929456 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:11.929345 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" event={"ID":"1558e454-9c8a-4f77-b581-077f7e79365a","Type":"ContainerDied","Data":"1c20652b269a0f6aac4112f72f4676374fbcce7b7d8753840df1e299aecd3fa3"} Jun 06 16:56:13.088767 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.088730 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qqfnp"] Jun 06 16:56:13.092574 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.092551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.094692 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.094668 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:13.095323 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.095304 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 06 16:56:13.095408 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.095372 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hkn2s\"" Jun 06 16:56:13.107001 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.106975 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc"] Jun 06 16:56:13.107369 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107351 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="pull" Jun 06 16:56:13.107369 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107369 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="pull" Jun 06 16:56:13.107533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107382 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="extract" Jun 06 16:56:13.107533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107389 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="extract" Jun 06 16:56:13.107533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107407 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="util" Jun 06 16:56:13.107533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107413 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="util" Jun 06 16:56:13.107533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.107496 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1558e454-9c8a-4f77-b581-077f7e79365a" containerName="extract" Jun 06 16:56:13.110269 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.110252 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qqfnp"] Jun 06 16:56:13.110357 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.110331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.113083 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.113062 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 06 16:56:13.113194 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.113161 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4s7wr\"" Jun 06 16:56:13.124296 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.124271 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc"] Jun 06 16:56:13.192042 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.191961 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-util\") pod \"1558e454-9c8a-4f77-b581-077f7e79365a\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " Jun 06 16:56:13.192042 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192022 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg2mg\" (UniqueName: \"kubernetes.io/projected/1558e454-9c8a-4f77-b581-077f7e79365a-kube-api-access-dg2mg\") pod \"1558e454-9c8a-4f77-b581-077f7e79365a\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " Jun 06 16:56:13.192042 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192042 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-bundle\") pod \"1558e454-9c8a-4f77-b581-077f7e79365a\" (UID: \"1558e454-9c8a-4f77-b581-077f7e79365a\") " Jun 06 16:56:13.192325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j77wd\" (UniqueName: \"kubernetes.io/projected/2a0f4f08-5344-441a-a62d-d859662ef1b9-kube-api-access-j77wd\") pod \"llmisvc-controller-manager-864bfd7bc9-fb2nc\" (UID: \"2a0f4f08-5344-441a-a62d-d859662ef1b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.192325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct28x\" (UniqueName: \"kubernetes.io/projected/69efe871-bd2d-44b5-8896-c0fc65ca47a7-kube-api-access-ct28x\") pod \"kserve-controller-manager-69fc866d76-qqfnp\" (UID: \"69efe871-bd2d-44b5-8896-c0fc65ca47a7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.192325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f4f08-5344-441a-a62d-d859662ef1b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fb2nc\" (UID: \"2a0f4f08-5344-441a-a62d-d859662ef1b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.192325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69efe871-bd2d-44b5-8896-c0fc65ca47a7-cert\") pod \"kserve-controller-manager-69fc866d76-qqfnp\" (UID: \"69efe871-bd2d-44b5-8896-c0fc65ca47a7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.193001 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.192971 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-bundle" (OuterVolumeSpecName: "bundle") pod "1558e454-9c8a-4f77-b581-077f7e79365a" (UID: "1558e454-9c8a-4f77-b581-077f7e79365a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:56:13.194321 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.194284 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1558e454-9c8a-4f77-b581-077f7e79365a-kube-api-access-dg2mg" (OuterVolumeSpecName: "kube-api-access-dg2mg") pod "1558e454-9c8a-4f77-b581-077f7e79365a" (UID: "1558e454-9c8a-4f77-b581-077f7e79365a"). InnerVolumeSpecName "kube-api-access-dg2mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:56:13.197826 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.197787 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-util" (OuterVolumeSpecName: "util") pod "1558e454-9c8a-4f77-b581-077f7e79365a" (UID: "1558e454-9c8a-4f77-b581-077f7e79365a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:56:13.293621 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct28x\" (UniqueName: \"kubernetes.io/projected/69efe871-bd2d-44b5-8896-c0fc65ca47a7-kube-api-access-ct28x\") pod \"kserve-controller-manager-69fc866d76-qqfnp\" (UID: \"69efe871-bd2d-44b5-8896-c0fc65ca47a7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.293773 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293633 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f4f08-5344-441a-a62d-d859662ef1b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fb2nc\" (UID: \"2a0f4f08-5344-441a-a62d-d859662ef1b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.293773 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69efe871-bd2d-44b5-8896-c0fc65ca47a7-cert\") pod \"kserve-controller-manager-69fc866d76-qqfnp\" (UID: \"69efe871-bd2d-44b5-8896-c0fc65ca47a7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.293773 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j77wd\" (UniqueName: \"kubernetes.io/projected/2a0f4f08-5344-441a-a62d-d859662ef1b9-kube-api-access-j77wd\") pod \"llmisvc-controller-manager-864bfd7bc9-fb2nc\" (UID: \"2a0f4f08-5344-441a-a62d-d859662ef1b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.293890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293774 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg2mg\" (UniqueName: \"kubernetes.io/projected/1558e454-9c8a-4f77-b581-077f7e79365a-kube-api-access-dg2mg\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:56:13.293890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293789 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:56:13.293890 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.293804 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1558e454-9c8a-4f77-b581-077f7e79365a-util\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:56:13.296123 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.296090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a0f4f08-5344-441a-a62d-d859662ef1b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fb2nc\" (UID: \"2a0f4f08-5344-441a-a62d-d859662ef1b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.296258 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.296165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69efe871-bd2d-44b5-8896-c0fc65ca47a7-cert\") pod \"kserve-controller-manager-69fc866d76-qqfnp\" (UID: \"69efe871-bd2d-44b5-8896-c0fc65ca47a7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.303772 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.303744 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct28x\" (UniqueName: \"kubernetes.io/projected/69efe871-bd2d-44b5-8896-c0fc65ca47a7-kube-api-access-ct28x\") pod \"kserve-controller-manager-69fc866d76-qqfnp\" (UID: \"69efe871-bd2d-44b5-8896-c0fc65ca47a7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.304256 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.304234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j77wd\" (UniqueName: \"kubernetes.io/projected/2a0f4f08-5344-441a-a62d-d859662ef1b9-kube-api-access-j77wd\") pod \"llmisvc-controller-manager-864bfd7bc9-fb2nc\" (UID: \"2a0f4f08-5344-441a-a62d-d859662ef1b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.402369 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.402323 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:13.421750 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.421718 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:13.545137 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.545108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qqfnp"] Jun 06 16:56:13.547355 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:13.547324 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69efe871_bd2d_44b5_8896_c0fc65ca47a7.slice/crio-8fce9e3c7f9217156b45f651f5ba3131b4728ff075f5b3a72b29b0ebb59ea0a1 WatchSource:0}: Error finding container 8fce9e3c7f9217156b45f651f5ba3131b4728ff075f5b3a72b29b0ebb59ea0a1: Status 404 returned error can't find the container with id 8fce9e3c7f9217156b45f651f5ba3131b4728ff075f5b3a72b29b0ebb59ea0a1 Jun 06 16:56:13.569123 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.569098 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc"] Jun 06 16:56:13.571119 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:13.571094 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2a0f4f08_5344_441a_a62d_d859662ef1b9.slice/crio-baf8dd041e9eb875e7c3db14090f2a93a9ef7ae33e04212ca70ddff61bfb1720 WatchSource:0}: Error finding container baf8dd041e9eb875e7c3db14090f2a93a9ef7ae33e04212ca70ddff61bfb1720: Status 404 returned error can't find the container with id baf8dd041e9eb875e7c3db14090f2a93a9ef7ae33e04212ca70ddff61bfb1720 Jun 06 16:56:13.939042 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.939006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" event={"ID":"2a0f4f08-5344-441a-a62d-d859662ef1b9","Type":"ContainerStarted","Data":"baf8dd041e9eb875e7c3db14090f2a93a9ef7ae33e04212ca70ddff61bfb1720"} Jun 06 16:56:13.940156 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.940129 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" event={"ID":"69efe871-bd2d-44b5-8896-c0fc65ca47a7","Type":"ContainerStarted","Data":"8fce9e3c7f9217156b45f651f5ba3131b4728ff075f5b3a72b29b0ebb59ea0a1"} Jun 06 16:56:13.941798 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.941777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" event={"ID":"1558e454-9c8a-4f77-b581-077f7e79365a","Type":"ContainerDied","Data":"a7ccda123998a56c39fb846c602da7f231a5a76bdc9bae8f73debe7e5b98eb24"} Jun 06 16:56:13.941904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.941812 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7ccda123998a56c39fb846c602da7f231a5a76bdc9bae8f73debe7e5b98eb24" Jun 06 16:56:13.941904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:13.941832 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0675znr" Jun 06 16:56:15.953400 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:15.953302 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" event={"ID":"69efe871-bd2d-44b5-8896-c0fc65ca47a7","Type":"ContainerStarted","Data":"92316082c9833e524d478dfc032805f2312130ecb326439c59ab2ee420cf41e7"} Jun 06 16:56:15.953764 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:15.953414 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:15.970720 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:15.970667 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" podStartSLOduration=0.850804476 podStartE2EDuration="2.970652068s" totalImagesPullingTime="2.119847592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:15.970149568 +0000 UTC m=+507.402987101" watchObservedRunningTime="2026-06-06 16:56:15.970652068 +0000 UTC m=+507.403489598" Jun 06 16:56:16.959305 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:16.959208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" event={"ID":"2a0f4f08-5344-441a-a62d-d859662ef1b9","Type":"ContainerStarted","Data":"c78f2d6b33ea7c0b5f269ff29d0d9ce4ff804ef2e4aa12183d85aa28e95a3bfd"} Jun 06 16:56:16.959679 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:16.959536 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:56:16.975512 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:16.975464 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" podStartSLOduration=0.870574992 podStartE2EDuration="3.975448649s" totalImagesPullingTime="3.104873657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:16.973762223 +0000 UTC m=+508.406599754" watchObservedRunningTime="2026-06-06 16:56:16.975448649 +0000 UTC m=+508.408286172" Jun 06 16:56:20.922855 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:20.922823 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-q79j9" Jun 06 16:56:20.925694 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:20.925675 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-9r5bt" Jun 06 16:56:21.983590 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:21.983557 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg"] Jun 06 16:56:21.989912 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:21.989885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:21.993427 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:21.993401 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 16:56:21.993563 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:21.993473 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 16:56:21.993563 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:21.993509 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wnlgj\"" Jun 06 16:56:21.999504 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:21.999484 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg"] Jun 06 16:56:22.075590 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.075548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vztq8\" (UniqueName: \"kubernetes.io/projected/8246b63a-26fa-4bbf-9fcd-cf796519bf97-kube-api-access-vztq8\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.075752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.075603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.075752 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.075705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.176370 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.176332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vztq8\" (UniqueName: \"kubernetes.io/projected/8246b63a-26fa-4bbf-9fcd-cf796519bf97-kube-api-access-vztq8\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.176503 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.176381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.176503 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.176414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.176747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.176730 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.176828 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.176808 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.194993 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.194963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vztq8\" (UniqueName: \"kubernetes.io/projected/8246b63a-26fa-4bbf-9fcd-cf796519bf97-kube-api-access-vztq8\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.299347 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.299312 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:22.450834 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.450809 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg"] Jun 06 16:56:22.453217 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:22.453191 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8246b63a_26fa_4bbf_9fcd_cf796519bf97.slice/crio-2479848a7caa8b70df4628e455f8b7ff2c6c2a1c671f42d5debefafefebef061 WatchSource:0}: Error finding container 2479848a7caa8b70df4628e455f8b7ff2c6c2a1c671f42d5debefafefebef061: Status 404 returned error can't find the container with id 2479848a7caa8b70df4628e455f8b7ff2c6c2a1c671f42d5debefafefebef061 Jun 06 16:56:22.996591 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.996555 2572 generic.go:356] "Generic (PLEG): container finished" podID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerID="e8035c0a5a4cf1f255825696d71769620b52d2b150f1934732a339102ac55905" exitCode=0 Jun 06 16:56:22.996998 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.996642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" event={"ID":"8246b63a-26fa-4bbf-9fcd-cf796519bf97","Type":"ContainerDied","Data":"e8035c0a5a4cf1f255825696d71769620b52d2b150f1934732a339102ac55905"} Jun 06 16:56:22.996998 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:22.996695 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" event={"ID":"8246b63a-26fa-4bbf-9fcd-cf796519bf97","Type":"ContainerStarted","Data":"2479848a7caa8b70df4628e455f8b7ff2c6c2a1c671f42d5debefafefebef061"} Jun 06 16:56:23.314139 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.314056 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr"] Jun 06 16:56:23.316872 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.316855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.321642 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.321618 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 06 16:56:23.321813 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.321661 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 06 16:56:23.321813 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.321664 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jnmjg\"" Jun 06 16:56:23.335337 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.335309 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr"] Jun 06 16:56:23.387709 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.387668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnb9k\" (UniqueName: \"kubernetes.io/projected/d97ba97e-0ae6-4853-ae24-77ef89ce7237-kube-api-access-bnb9k\") pod \"servicemesh-operator3-57f65f65fb-w4cdr\" (UID: \"d97ba97e-0ae6-4853-ae24-77ef89ce7237\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.387888 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.387729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d97ba97e-0ae6-4853-ae24-77ef89ce7237-operator-config\") pod \"servicemesh-operator3-57f65f65fb-w4cdr\" (UID: \"d97ba97e-0ae6-4853-ae24-77ef89ce7237\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.488838 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.488797 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d97ba97e-0ae6-4853-ae24-77ef89ce7237-operator-config\") pod \"servicemesh-operator3-57f65f65fb-w4cdr\" (UID: \"d97ba97e-0ae6-4853-ae24-77ef89ce7237\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.488970 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.488873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnb9k\" (UniqueName: \"kubernetes.io/projected/d97ba97e-0ae6-4853-ae24-77ef89ce7237-kube-api-access-bnb9k\") pod \"servicemesh-operator3-57f65f65fb-w4cdr\" (UID: \"d97ba97e-0ae6-4853-ae24-77ef89ce7237\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.491445 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.491415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d97ba97e-0ae6-4853-ae24-77ef89ce7237-operator-config\") pod \"servicemesh-operator3-57f65f65fb-w4cdr\" (UID: \"d97ba97e-0ae6-4853-ae24-77ef89ce7237\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.496860 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.496837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnb9k\" (UniqueName: \"kubernetes.io/projected/d97ba97e-0ae6-4853-ae24-77ef89ce7237-kube-api-access-bnb9k\") pod \"servicemesh-operator3-57f65f65fb-w4cdr\" (UID: \"d97ba97e-0ae6-4853-ae24-77ef89ce7237\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.626795 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.626720 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:23.787108 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:23.787084 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr"] Jun 06 16:56:23.835322 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:23.835283 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97ba97e_0ae6_4853_ae24_77ef89ce7237.slice/crio-5101edb7f7d9858d5cf32b9ddc2db46e20d361af350e5b5eea6048546579e80d WatchSource:0}: Error finding container 5101edb7f7d9858d5cf32b9ddc2db46e20d361af350e5b5eea6048546579e80d: Status 404 returned error can't find the container with id 5101edb7f7d9858d5cf32b9ddc2db46e20d361af350e5b5eea6048546579e80d Jun 06 16:56:24.003158 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:24.003116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" event={"ID":"d97ba97e-0ae6-4853-ae24-77ef89ce7237","Type":"ContainerStarted","Data":"5101edb7f7d9858d5cf32b9ddc2db46e20d361af350e5b5eea6048546579e80d"} Jun 06 16:56:24.004789 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:24.004764 2572 generic.go:356] "Generic (PLEG): container finished" podID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerID="99deb470db26f903abdba25f89fcc02b555d33123836bfa80bc574af70e3cd6b" exitCode=0 Jun 06 16:56:24.004895 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:24.004838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" event={"ID":"8246b63a-26fa-4bbf-9fcd-cf796519bf97","Type":"ContainerDied","Data":"99deb470db26f903abdba25f89fcc02b555d33123836bfa80bc574af70e3cd6b"} Jun 06 16:56:25.018106 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:25.018067 2572 generic.go:356] "Generic (PLEG): container finished" podID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerID="92359b017af8229f492d304c9eef4ee4f4a27033711e117a8df721359ed78307" exitCode=0 Jun 06 16:56:25.018485 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:25.018148 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" event={"ID":"8246b63a-26fa-4bbf-9fcd-cf796519bf97","Type":"ContainerDied","Data":"92359b017af8229f492d304c9eef4ee4f4a27033711e117a8df721359ed78307"} Jun 06 16:56:26.161591 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.161563 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:26.211349 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.211328 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vztq8\" (UniqueName: \"kubernetes.io/projected/8246b63a-26fa-4bbf-9fcd-cf796519bf97-kube-api-access-vztq8\") pod \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " Jun 06 16:56:26.211457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.211391 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-bundle\") pod \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " Jun 06 16:56:26.211515 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.211481 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-util\") pod \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\" (UID: \"8246b63a-26fa-4bbf-9fcd-cf796519bf97\") " Jun 06 16:56:26.212550 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.212523 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-bundle" (OuterVolumeSpecName: "bundle") pod "8246b63a-26fa-4bbf-9fcd-cf796519bf97" (UID: "8246b63a-26fa-4bbf-9fcd-cf796519bf97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:56:26.213325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.213304 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8246b63a-26fa-4bbf-9fcd-cf796519bf97-kube-api-access-vztq8" (OuterVolumeSpecName: "kube-api-access-vztq8") pod "8246b63a-26fa-4bbf-9fcd-cf796519bf97" (UID: "8246b63a-26fa-4bbf-9fcd-cf796519bf97"). InnerVolumeSpecName "kube-api-access-vztq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:56:26.217202 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.217176 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-util" (OuterVolumeSpecName: "util") pod "8246b63a-26fa-4bbf-9fcd-cf796519bf97" (UID: "8246b63a-26fa-4bbf-9fcd-cf796519bf97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:56:26.312453 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.312363 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-util\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:56:26.312453 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.312390 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vztq8\" (UniqueName: \"kubernetes.io/projected/8246b63a-26fa-4bbf-9fcd-cf796519bf97-kube-api-access-vztq8\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:56:26.312453 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:26.312400 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8246b63a-26fa-4bbf-9fcd-cf796519bf97-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:56:27.029358 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:27.029331 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" event={"ID":"d97ba97e-0ae6-4853-ae24-77ef89ce7237","Type":"ContainerStarted","Data":"4766328fd34a497a58167467b2185b0545c17f082d25ba29f96bd869ccc0a229"} Jun 06 16:56:27.029524 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:27.029452 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:27.031354 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:27.031329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" event={"ID":"8246b63a-26fa-4bbf-9fcd-cf796519bf97","Type":"ContainerDied","Data":"2479848a7caa8b70df4628e455f8b7ff2c6c2a1c671f42d5debefafefebef061"} Jun 06 16:56:27.031354 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:27.031350 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abg2vg" Jun 06 16:56:27.031488 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:27.031370 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2479848a7caa8b70df4628e455f8b7ff2c6c2a1c671f42d5debefafefebef061" Jun 06 16:56:27.052904 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:27.052857 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" podStartSLOduration=1.698568139 podStartE2EDuration="4.052843666s" totalImagesPullingTime="2.354275527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:27.050451867 +0000 UTC m=+518.483289390" watchObservedRunningTime="2026-06-06 16:56:27.052843666 +0000 UTC m=+518.485681198" Jun 06 16:56:33.126871 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.126831 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t"] Jun 06 16:56:33.127400 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127380 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="extract" Jun 06 16:56:33.127500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127402 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="extract" Jun 06 16:56:33.127500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127420 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="util" Jun 06 16:56:33.127500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127428 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="util" Jun 06 16:56:33.127500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127454 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="pull" Jun 06 16:56:33.127500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127463 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="pull" Jun 06 16:56:33.127647 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.127570 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8246b63a-26fa-4bbf-9fcd-cf796519bf97" containerName="extract" Jun 06 16:56:33.130952 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.130935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.133740 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.133717 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 16:56:33.133863 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.133776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f7w48\"" Jun 06 16:56:33.133863 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.133725 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 06 16:56:33.133863 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.133728 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 06 16:56:33.133863 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.133731 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 06 16:56:33.142923 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.142899 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t"] Jun 06 16:56:33.271241 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.271402 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxxg8\" (UniqueName: \"kubernetes.io/projected/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-kube-api-access-gxxg8\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.271402 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.271402 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.271402 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271341 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.271598 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271416 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.271598 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.271486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.371876 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.371842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372024 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.371899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372024 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.371918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxxg8\" (UniqueName: \"kubernetes.io/projected/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-kube-api-access-gxxg8\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372024 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.371977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372193 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.372020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372193 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.372053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372193 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.372084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.372764 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.372738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.374676 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.374646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.374771 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.374707 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.374771 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.374743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.374944 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.374920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.380716 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.380649 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.380964 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.380940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxxg8\" (UniqueName: \"kubernetes.io/projected/8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f-kube-api-access-gxxg8\") pod \"istiod-openshift-gateway-75c67f8887-8w96t\" (UID: \"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.440852 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.440813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:33.588529 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:33.588501 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t"] Jun 06 16:56:33.590510 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:33.590481 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1c9505_0c3c_4aa7_bba4_0c048e7ca73f.slice/crio-58393b29e9a267c2a97c95f07a728b395905f10a651821494e24c596a1b61d40 WatchSource:0}: Error finding container 58393b29e9a267c2a97c95f07a728b395905f10a651821494e24c596a1b61d40: Status 404 returned error can't find the container with id 58393b29e9a267c2a97c95f07a728b395905f10a651821494e24c596a1b61d40 Jun 06 16:56:34.067500 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:34.067463 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" event={"ID":"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f","Type":"ContainerStarted","Data":"58393b29e9a267c2a97c95f07a728b395905f10a651821494e24c596a1b61d40"} Jun 06 16:56:37.574777 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:37.574733 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 16:56:37.575175 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:37.574819 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 16:56:38.038782 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:38.038751 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-w4cdr" Jun 06 16:56:38.089561 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:38.089526 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" event={"ID":"8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f","Type":"ContainerStarted","Data":"b02f7949ccec56fc3a49360e700ab7e067d300b95b8d93849d1858d023a162f6"} Jun 06 16:56:38.089747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:38.089700 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:38.091218 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:38.091194 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-8w96t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 06 16:56:38.091328 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:38.091238 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" podUID="8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 16:56:38.109860 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:38.109805 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" podStartSLOduration=1.128117948 podStartE2EDuration="5.109784403s" totalImagesPullingTime="3.981666455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:38.108838577 +0000 UTC m=+529.541676110" watchObservedRunningTime="2026-06-06 16:56:38.109784403 +0000 UTC m=+529.542621937" Jun 06 16:56:39.095101 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.095073 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8w96t" Jun 06 16:56:39.605817 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.605779 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f6689757f-gsv5v"] Jun 06 16:56:39.651324 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.651282 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f6689757f-gsv5v"] Jun 06 16:56:39.651526 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.651413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.655063 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.655040 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 16:56:39.655186 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.655102 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jpvwz\"" Jun 06 16:56:39.727297 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.727260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbnl\" (UniqueName: \"kubernetes.io/projected/a675fad7-fa1a-4018-9c81-a25d58c3f82b-kube-api-access-nzbnl\") pod \"dashboard-redirect-5f6689757f-gsv5v\" (UID: \"a675fad7-fa1a-4018-9c81-a25d58c3f82b\") " pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.727482 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.727328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a675fad7-fa1a-4018-9c81-a25d58c3f82b-redirect-config\") pod \"dashboard-redirect-5f6689757f-gsv5v\" (UID: \"a675fad7-fa1a-4018-9c81-a25d58c3f82b\") " pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.828045 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.828006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a675fad7-fa1a-4018-9c81-a25d58c3f82b-redirect-config\") pod \"dashboard-redirect-5f6689757f-gsv5v\" (UID: \"a675fad7-fa1a-4018-9c81-a25d58c3f82b\") " pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.828208 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.828087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbnl\" (UniqueName: \"kubernetes.io/projected/a675fad7-fa1a-4018-9c81-a25d58c3f82b-kube-api-access-nzbnl\") pod \"dashboard-redirect-5f6689757f-gsv5v\" (UID: \"a675fad7-fa1a-4018-9c81-a25d58c3f82b\") " pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.828731 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.828712 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a675fad7-fa1a-4018-9c81-a25d58c3f82b-redirect-config\") pod \"dashboard-redirect-5f6689757f-gsv5v\" (UID: \"a675fad7-fa1a-4018-9c81-a25d58c3f82b\") " pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.836791 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.836751 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbnl\" (UniqueName: \"kubernetes.io/projected/a675fad7-fa1a-4018-9c81-a25d58c3f82b-kube-api-access-nzbnl\") pod \"dashboard-redirect-5f6689757f-gsv5v\" (UID: \"a675fad7-fa1a-4018-9c81-a25d58c3f82b\") " pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:39.961238 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:39.961158 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" Jun 06 16:56:40.131166 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:40.131023 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f6689757f-gsv5v"] Jun 06 16:56:40.133637 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:56:40.133606 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda675fad7_fa1a_4018_9c81_a25d58c3f82b.slice/crio-85f3fccf7ded8fca8eb8988e43373c9a6cfb54b752a64fdaa61984be6e2a9b1c WatchSource:0}: Error finding container 85f3fccf7ded8fca8eb8988e43373c9a6cfb54b752a64fdaa61984be6e2a9b1c: Status 404 returned error can't find the container with id 85f3fccf7ded8fca8eb8988e43373c9a6cfb54b752a64fdaa61984be6e2a9b1c Jun 06 16:56:41.106274 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:41.106234 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" event={"ID":"a675fad7-fa1a-4018-9c81-a25d58c3f82b","Type":"ContainerStarted","Data":"85f3fccf7ded8fca8eb8988e43373c9a6cfb54b752a64fdaa61984be6e2a9b1c"} Jun 06 16:56:43.120019 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:43.119980 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" event={"ID":"a675fad7-fa1a-4018-9c81-a25d58c3f82b","Type":"ContainerStarted","Data":"9803dba111ce29adcf9a30d69986e8a49f3416e6bbfa040f2059e7fd021c3f4c"} Jun 06 16:56:43.134396 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:43.134348 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f6689757f-gsv5v" podStartSLOduration=1.904095587 podStartE2EDuration="4.134333857s" totalImagesPullingTime="2.23023827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:56:43.13410513 +0000 UTC m=+534.566942664" watchObservedRunningTime="2026-06-06 16:56:43.134333857 +0000 UTC m=+534.567171388" Jun 06 16:56:46.964555 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:46.964523 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qqfnp" Jun 06 16:56:47.966607 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:56:47.966577 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fb2nc" Jun 06 16:57:09.767458 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.767390 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ddb698c84-qsjqn"] Jun 06 16:57:09.774306 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.774280 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.779310 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.779284 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddb698c84-qsjqn"] Jun 06 16:57:09.890874 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.890832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-config\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.890874 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.890878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-oauth-serving-cert\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.891140 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.890970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-service-ca\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.891140 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.891001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-serving-cert\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.891140 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.891045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcz5w\" (UniqueName: \"kubernetes.io/projected/8cf9c75f-67da-4611-826b-fd07a07ab03f-kube-api-access-pcz5w\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.891140 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.891078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-trusted-ca-bundle\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.891140 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.891105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-oauth-config\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992171 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-service-ca\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992171 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992176 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-serving-cert\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcz5w\" (UniqueName: \"kubernetes.io/projected/8cf9c75f-67da-4611-826b-fd07a07ab03f-kube-api-access-pcz5w\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-trusted-ca-bundle\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-oauth-config\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-config\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.992479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.992378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-oauth-serving-cert\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.993087 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.993046 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-service-ca\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.993087 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.993061 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-config\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.993271 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.993131 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-oauth-serving-cert\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.993271 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.993171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf9c75f-67da-4611-826b-fd07a07ab03f-trusted-ca-bundle\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.994869 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.994822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-serving-cert\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:09.994953 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:09.994928 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf9c75f-67da-4611-826b-fd07a07ab03f-console-oauth-config\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:10.000317 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:10.000294 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcz5w\" (UniqueName: \"kubernetes.io/projected/8cf9c75f-67da-4611-826b-fd07a07ab03f-kube-api-access-pcz5w\") pod \"console-6ddb698c84-qsjqn\" (UID: \"8cf9c75f-67da-4611-826b-fd07a07ab03f\") " pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:10.084828 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:10.084736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:10.215988 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:10.215963 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddb698c84-qsjqn"] Jun 06 16:57:10.218824 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:57:10.218798 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf9c75f_67da_4611_826b_fd07a07ab03f.slice/crio-29a31d9b3f4d8a72307d6827c3c91b2c15e73e643117929baa0d3c57393504d2 WatchSource:0}: Error finding container 29a31d9b3f4d8a72307d6827c3c91b2c15e73e643117929baa0d3c57393504d2: Status 404 returned error can't find the container with id 29a31d9b3f4d8a72307d6827c3c91b2c15e73e643117929baa0d3c57393504d2 Jun 06 16:57:10.250554 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:10.250523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddb698c84-qsjqn" event={"ID":"8cf9c75f-67da-4611-826b-fd07a07ab03f","Type":"ContainerStarted","Data":"29a31d9b3f4d8a72307d6827c3c91b2c15e73e643117929baa0d3c57393504d2"} Jun 06 16:57:11.256815 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:11.256775 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddb698c84-qsjqn" event={"ID":"8cf9c75f-67da-4611-826b-fd07a07ab03f","Type":"ContainerStarted","Data":"31c3997416c7cbd6747f7940937fb6a89d32d9a89ac6da615c56641de7368f64"} Jun 06 16:57:11.274552 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:11.274504 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ddb698c84-qsjqn" podStartSLOduration=2.274489809 podStartE2EDuration="2.274489809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:11.273901159 +0000 UTC m=+562.706738694" watchObservedRunningTime="2026-06-06 16:57:11.274489809 +0000 UTC m=+562.707327342" Jun 06 16:57:20.085246 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:20.085207 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:20.085684 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:20.085276 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:20.090401 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:20.090365 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:20.305915 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:20.305884 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ddb698c84-qsjqn" Jun 06 16:57:20.351930 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:20.351847 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-977cb4dc-rh6x4"] Jun 06 16:57:45.371887 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.371840 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-977cb4dc-rh6x4" podUID="6e1cef7e-9f96-4815-b3db-b4a8e02e1015" containerName="console" containerID="cri-o://a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6" gracePeriod=15 Jun 06 16:57:45.622063 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.622008 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:57:45.712490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712454 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-trusted-ca-bundle\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.712490 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712492 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-service-ca\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.712705 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712529 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-oauth-config\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.712705 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712588 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-serving-cert\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.712705 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712616 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-oauth-serving-cert\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.712705 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712641 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-config\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.712705 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712692 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptbxl\" (UniqueName: \"kubernetes.io/projected/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-kube-api-access-ptbxl\") pod \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\" (UID: \"6e1cef7e-9f96-4815-b3db-b4a8e02e1015\") " Jun 06 16:57:45.713009 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.712882 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:57:45.713146 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.713102 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:57:45.713254 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.713120 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-config" (OuterVolumeSpecName: "console-config") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:57:45.713254 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.713226 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:57:45.714827 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.714796 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-kube-api-access-ptbxl" (OuterVolumeSpecName: "kube-api-access-ptbxl") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "kube-api-access-ptbxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:45.714912 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.714838 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:57:45.714912 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.714852 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e1cef7e-9f96-4815-b3db-b4a8e02e1015" (UID: "6e1cef7e-9f96-4815-b3db-b4a8e02e1015"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 16:57:45.813829 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813796 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-trusted-ca-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:45.813829 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813823 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-service-ca\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:45.813829 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813832 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-oauth-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:45.814062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813840 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:45.814062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813849 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-oauth-serving-cert\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:45.814062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813858 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-console-config\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:45.814062 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:45.813866 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptbxl\" (UniqueName: \"kubernetes.io/projected/6e1cef7e-9f96-4815-b3db-b4a8e02e1015-kube-api-access-ptbxl\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:46.020409 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.020374 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf"] Jun 06 16:57:46.020717 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.020703 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1cef7e-9f96-4815-b3db-b4a8e02e1015" containerName="console" Jun 06 16:57:46.020760 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.020718 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1cef7e-9f96-4815-b3db-b4a8e02e1015" containerName="console" Jun 06 16:57:46.020794 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.020789 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1cef7e-9f96-4815-b3db-b4a8e02e1015" containerName="console" Jun 06 16:57:46.024047 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.024026 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:46.026854 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.026832 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xv2s2\"" Jun 06 16:57:46.026964 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.026854 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 16:57:46.026964 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.026911 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 16:57:46.035218 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.035196 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf"] Jun 06 16:57:46.116766 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.116731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5krpn\" (UniqueName: \"kubernetes.io/projected/a3bce8b0-ab87-431e-bc36-c89e3d098d7d-kube-api-access-5krpn\") pod \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" (UID: \"a3bce8b0-ab87-431e-bc36-c89e3d098d7d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:46.217587 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.217553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5krpn\" (UniqueName: \"kubernetes.io/projected/a3bce8b0-ab87-431e-bc36-c89e3d098d7d-kube-api-access-5krpn\") pod \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" (UID: \"a3bce8b0-ab87-431e-bc36-c89e3d098d7d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:46.225551 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.225517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5krpn\" (UniqueName: \"kubernetes.io/projected/a3bce8b0-ab87-431e-bc36-c89e3d098d7d-kube-api-access-5krpn\") pod \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" (UID: \"a3bce8b0-ab87-431e-bc36-c89e3d098d7d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:46.336675 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.336584 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:46.437258 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.437223 2572 generic.go:356] "Generic (PLEG): container finished" podID="6e1cef7e-9f96-4815-b3db-b4a8e02e1015" containerID="a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6" exitCode=0 Jun 06 16:57:46.437667 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.437281 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-977cb4dc-rh6x4" Jun 06 16:57:46.437667 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.437304 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-977cb4dc-rh6x4" event={"ID":"6e1cef7e-9f96-4815-b3db-b4a8e02e1015","Type":"ContainerDied","Data":"a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6"} Jun 06 16:57:46.437667 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.437399 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-977cb4dc-rh6x4" event={"ID":"6e1cef7e-9f96-4815-b3db-b4a8e02e1015","Type":"ContainerDied","Data":"4e21eff4055080864e10f30d68a4e923c1d5048a426324a0f666c72dce76b3ac"} Jun 06 16:57:46.437667 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.437449 2572 scope.go:117] "RemoveContainer" containerID="a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6" Jun 06 16:57:46.447807 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.447088 2572 scope.go:117] "RemoveContainer" containerID="a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6" Jun 06 16:57:46.450072 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:46.450041 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6\": container with ID starting with a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6 not found: ID does not exist" containerID="a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6" Jun 06 16:57:46.450474 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.450086 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6"} err="failed to get container status \"a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6\": rpc error: code = NotFound desc = could not find container \"a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6\": container with ID starting with a03e86b2dd787c36eae8ef901d52b2e6df06d390cc2112b9acea312e8bd24fc6 not found: ID does not exist" Jun 06 16:57:46.471813 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.471772 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-977cb4dc-rh6x4"] Jun 06 16:57:46.473545 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:57:46.473517 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bce8b0_ab87_431e_bc36_c89e3d098d7d.slice/crio-d5a3d2bc523a9781aa5fba421799668946e43bf51985ee65888fde77f8136dc9 WatchSource:0}: Error finding container d5a3d2bc523a9781aa5fba421799668946e43bf51985ee65888fde77f8136dc9: Status 404 returned error can't find the container with id d5a3d2bc523a9781aa5fba421799668946e43bf51985ee65888fde77f8136dc9 Jun 06 16:57:46.474271 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.474252 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf"] Jun 06 16:57:46.476191 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:46.476171 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-977cb4dc-rh6x4"] Jun 06 16:57:47.010525 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:47.010494 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1cef7e-9f96-4815-b3db-b4a8e02e1015" path="/var/lib/kubelet/pods/6e1cef7e-9f96-4815-b3db-b4a8e02e1015/volumes" Jun 06 16:57:47.448415 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:47.448321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" event={"ID":"a3bce8b0-ab87-431e-bc36-c89e3d098d7d","Type":"ContainerStarted","Data":"d5a3d2bc523a9781aa5fba421799668946e43bf51985ee65888fde77f8136dc9"} Jun 06 16:57:48.455410 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:48.455323 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" event={"ID":"a3bce8b0-ab87-431e-bc36-c89e3d098d7d","Type":"ContainerStarted","Data":"de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1"} Jun 06 16:57:48.455410 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:48.455401 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:48.472044 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:48.471997 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" podStartSLOduration=0.789603555 podStartE2EDuration="2.47198103s" totalImagesPullingTime="1.682377475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:48.47107589 +0000 UTC m=+599.903913424" watchObservedRunningTime="2026-06-06 16:57:48.47198103 +0000 UTC m=+599.904818561" Jun 06 16:57:48.991574 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:48.991544 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:57:48.993092 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:48.993068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 16:57:55.861678 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.861642 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf"] Jun 06 16:57:55.864236 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.861870 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" containerName="manager" containerID="cri-o://de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1" gracePeriod=2 Jun 06 16:57:55.864236 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.863769 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:55.874256 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.874228 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf"] Jun 06 16:57:55.887039 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:55.886997 2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a3bce8b0-ab87-431e-bc36-c89e3d098d7d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-fzsrf\": pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:55.889058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.889032 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r"] Jun 06 16:57:55.889282 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:55.889253 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:55.889457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.889422 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" containerName="manager" Jun 06 16:57:55.889457 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.889454 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" containerName="manager" Jun 06 16:57:55.889528 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.889506 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" containerName="manager" Jun 06 16:57:55.892600 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.892578 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:57:55.894898 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:55.894867 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:55.902199 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:55.902170 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r"] Jun 06 16:57:56.000788 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.000750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4rg\" (UniqueName: \"kubernetes.io/projected/4516593e-c378-496b-babe-fe5e436a8c96-kube-api-access-ms4rg\") pod \"limitador-operator-controller-manager-859d7b78bd-6jr6r\" (UID: \"4516593e-c378-496b-babe-fe5e436a8c96\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:57:56.097704 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.097679 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:56.100133 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:56.100108 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:56.101502 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.101483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4rg\" (UniqueName: \"kubernetes.io/projected/4516593e-c378-496b-babe-fe5e436a8c96-kube-api-access-ms4rg\") pod \"limitador-operator-controller-manager-859d7b78bd-6jr6r\" (UID: \"4516593e-c378-496b-babe-fe5e436a8c96\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:57:56.109709 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.109688 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4rg\" (UniqueName: \"kubernetes.io/projected/4516593e-c378-496b-babe-fe5e436a8c96-kube-api-access-ms4rg\") pod \"limitador-operator-controller-manager-859d7b78bd-6jr6r\" (UID: \"4516593e-c378-496b-babe-fe5e436a8c96\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:57:56.202880 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.202790 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5krpn\" (UniqueName: \"kubernetes.io/projected/a3bce8b0-ab87-431e-bc36-c89e3d098d7d-kube-api-access-5krpn\") pod \"a3bce8b0-ab87-431e-bc36-c89e3d098d7d\" (UID: \"a3bce8b0-ab87-431e-bc36-c89e3d098d7d\") " Jun 06 16:57:56.205011 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.204984 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bce8b0-ab87-431e-bc36-c89e3d098d7d-kube-api-access-5krpn" (OuterVolumeSpecName: "kube-api-access-5krpn") pod "a3bce8b0-ab87-431e-bc36-c89e3d098d7d" (UID: "a3bce8b0-ab87-431e-bc36-c89e3d098d7d"). InnerVolumeSpecName "kube-api-access-5krpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:57:56.235174 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.235144 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:57:56.303768 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.303739 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5krpn\" (UniqueName: \"kubernetes.io/projected/a3bce8b0-ab87-431e-bc36-c89e3d098d7d-kube-api-access-5krpn\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:57:56.366121 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.366094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r"] Jun 06 16:57:56.367786 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:57:56.367763 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4516593e_c378_496b_babe_fe5e436a8c96.slice/crio-64c264a8db533b281601ffec601ee7d924796f17dbfcc3dbd61f218a6ced302f WatchSource:0}: Error finding container 64c264a8db533b281601ffec601ee7d924796f17dbfcc3dbd61f218a6ced302f: Status 404 returned error can't find the container with id 64c264a8db533b281601ffec601ee7d924796f17dbfcc3dbd61f218a6ced302f Jun 06 16:57:56.500937 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.500899 2572 generic.go:356] "Generic (PLEG): container finished" podID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" containerID="de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1" exitCode=0 Jun 06 16:57:56.501115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.500947 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:56.501115 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.501001 2572 scope.go:117] "RemoveContainer" containerID="de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1" Jun 06 16:57:56.502875 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.502851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" event={"ID":"4516593e-c378-496b-babe-fe5e436a8c96","Type":"ContainerStarted","Data":"9b4cf0885f5f4829fe3fb75817973f3ece6650d8efacd92fb0b6fa73c8f23b23"} Jun 06 16:57:56.502994 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.502901 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:57:56.502994 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.502917 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" event={"ID":"4516593e-c378-496b-babe-fe5e436a8c96","Type":"ContainerStarted","Data":"64c264a8db533b281601ffec601ee7d924796f17dbfcc3dbd61f218a6ced302f"} Jun 06 16:57:56.503628 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:56.503604 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:56.505626 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:56.505598 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:56.510479 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.510461 2572 scope.go:117] "RemoveContainer" containerID="de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1" Jun 06 16:57:56.510772 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:56.510753 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1\": container with ID starting with de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1 not found: ID does not exist" containerID="de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1" Jun 06 16:57:56.510821 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.510782 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1"} err="failed to get container status \"de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1\": rpc error: code = NotFound desc = could not find container \"de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1\": container with ID starting with de134aaa54a19d7375fcdb624f6955df91ceccd18b0844a70e52f8b7615bc8b1 not found: ID does not exist" Jun 06 16:57:56.527858 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:56.527812 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" podStartSLOduration=1.527797155 podStartE2EDuration="1.527797155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:57:56.527267507 +0000 UTC m=+607.960105034" watchObservedRunningTime="2026-06-06 16:57:56.527797155 +0000 UTC m=+607.960634706" Jun 06 16:57:56.529379 ip-10-0-133-67 kubenswrapper[2572]: E0606 16:57:56.529354 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fzsrf\" is forbidden: User \"system:node:ip-10-0-133-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-67.ec2.internal' and this object" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fzsrf" Jun 06 16:57:57.009597 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:57:57.009567 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3bce8b0-ab87-431e-bc36-c89e3d098d7d" path="/var/lib/kubelet/pods/a3bce8b0-ab87-431e-bc36-c89e3d098d7d/volumes" Jun 06 16:58:07.511503 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:07.511404 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6jr6r" Jun 06 16:58:51.645601 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.645567 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:58:51.650116 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.650095 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.652646 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.652625 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tdj9d\"" Jun 06 16:58:51.652761 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.652685 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 16:58:51.656428 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.656406 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:58:51.737132 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.737098 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:58:51.780823 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.780789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e7fa44-636d-424f-a5f4-eb6422251b9b-config-file\") pod \"limitador-limitador-64c94fd64f-g7wxx\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.781009 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.780852 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx45d\" (UniqueName: \"kubernetes.io/projected/a1e7fa44-636d-424f-a5f4-eb6422251b9b-kube-api-access-xx45d\") pod \"limitador-limitador-64c94fd64f-g7wxx\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.882275 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.882239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx45d\" (UniqueName: \"kubernetes.io/projected/a1e7fa44-636d-424f-a5f4-eb6422251b9b-kube-api-access-xx45d\") pod \"limitador-limitador-64c94fd64f-g7wxx\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.882508 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.882303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e7fa44-636d-424f-a5f4-eb6422251b9b-config-file\") pod \"limitador-limitador-64c94fd64f-g7wxx\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.882922 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.882901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e7fa44-636d-424f-a5f4-eb6422251b9b-config-file\") pod \"limitador-limitador-64c94fd64f-g7wxx\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.889782 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.889761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx45d\" (UniqueName: \"kubernetes.io/projected/a1e7fa44-636d-424f-a5f4-eb6422251b9b-kube-api-access-xx45d\") pod \"limitador-limitador-64c94fd64f-g7wxx\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:51.961413 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:51.961326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:52.099385 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:52.099213 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:58:52.101552 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:58:52.101519 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e7fa44_636d_424f_a5f4_eb6422251b9b.slice/crio-a8abd47528915b15d96e0a92311aa123fd70f87d998ce318d4ecc4763cb20d40 WatchSource:0}: Error finding container a8abd47528915b15d96e0a92311aa123fd70f87d998ce318d4ecc4763cb20d40: Status 404 returned error can't find the container with id a8abd47528915b15d96e0a92311aa123fd70f87d998ce318d4ecc4763cb20d40 Jun 06 16:58:52.788274 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:52.788229 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" event={"ID":"a1e7fa44-636d-424f-a5f4-eb6422251b9b","Type":"ContainerStarted","Data":"a8abd47528915b15d96e0a92311aa123fd70f87d998ce318d4ecc4763cb20d40"} Jun 06 16:58:55.805886 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:55.805852 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" event={"ID":"a1e7fa44-636d-424f-a5f4-eb6422251b9b","Type":"ContainerStarted","Data":"b0f53a28c7b6c63b2cbe119017f4a3597eed860fc6c73708ed274c9209dcc680"} Jun 06 16:58:55.806308 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:55.805967 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:58:55.822456 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:58:55.822386 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" podStartSLOduration=2.159933099 podStartE2EDuration="4.82237051s" totalImagesPullingTime="2.662437411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:58:55.820801325 +0000 UTC m=+667.253638869" watchObservedRunningTime="2026-06-06 16:58:55.82237051 +0000 UTC m=+667.255208043" Jun 06 16:59:06.812453 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:06.812405 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:59:08.381039 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:08.380999 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:59:08.381492 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:08.381191 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" podUID="a1e7fa44-636d-424f-a5f4-eb6422251b9b" containerName="limitador" containerID="cri-o://b0f53a28c7b6c63b2cbe119017f4a3597eed860fc6c73708ed274c9209dcc680" gracePeriod=30 Jun 06 16:59:08.882236 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:08.882199 2572 generic.go:356] "Generic (PLEG): container finished" podID="a1e7fa44-636d-424f-a5f4-eb6422251b9b" containerID="b0f53a28c7b6c63b2cbe119017f4a3597eed860fc6c73708ed274c9209dcc680" exitCode=0 Jun 06 16:59:08.882402 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:08.882243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" event={"ID":"a1e7fa44-636d-424f-a5f4-eb6422251b9b","Type":"ContainerDied","Data":"b0f53a28c7b6c63b2cbe119017f4a3597eed860fc6c73708ed274c9209dcc680"} Jun 06 16:59:09.328272 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.328245 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:59:09.438747 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.438708 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e7fa44-636d-424f-a5f4-eb6422251b9b-config-file\") pod \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " Jun 06 16:59:09.439208 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.438782 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx45d\" (UniqueName: \"kubernetes.io/projected/a1e7fa44-636d-424f-a5f4-eb6422251b9b-kube-api-access-xx45d\") pod \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\" (UID: \"a1e7fa44-636d-424f-a5f4-eb6422251b9b\") " Jun 06 16:59:09.439208 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.439193 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e7fa44-636d-424f-a5f4-eb6422251b9b-config-file" (OuterVolumeSpecName: "config-file") pod "a1e7fa44-636d-424f-a5f4-eb6422251b9b" (UID: "a1e7fa44-636d-424f-a5f4-eb6422251b9b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 16:59:09.440916 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.440888 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e7fa44-636d-424f-a5f4-eb6422251b9b-kube-api-access-xx45d" (OuterVolumeSpecName: "kube-api-access-xx45d") pod "a1e7fa44-636d-424f-a5f4-eb6422251b9b" (UID: "a1e7fa44-636d-424f-a5f4-eb6422251b9b"). InnerVolumeSpecName "kube-api-access-xx45d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:59:09.539492 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.539425 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e7fa44-636d-424f-a5f4-eb6422251b9b-config-file\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:59:09.539492 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.539490 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx45d\" (UniqueName: \"kubernetes.io/projected/a1e7fa44-636d-424f-a5f4-eb6422251b9b-kube-api-access-xx45d\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:59:09.887836 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.887801 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" event={"ID":"a1e7fa44-636d-424f-a5f4-eb6422251b9b","Type":"ContainerDied","Data":"a8abd47528915b15d96e0a92311aa123fd70f87d998ce318d4ecc4763cb20d40"} Jun 06 16:59:09.888012 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.887860 2572 scope.go:117] "RemoveContainer" containerID="b0f53a28c7b6c63b2cbe119017f4a3597eed860fc6c73708ed274c9209dcc680" Jun 06 16:59:09.888012 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.887819 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7wxx" Jun 06 16:59:09.909024 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.908994 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:59:09.913065 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:09.913037 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7wxx"] Jun 06 16:59:11.010928 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:11.010891 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e7fa44-636d-424f-a5f4-eb6422251b9b" path="/var/lib/kubelet/pods/a1e7fa44-636d-424f-a5f4-eb6422251b9b/volumes" Jun 06 16:59:13.528058 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.528028 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n"] Jun 06 16:59:13.528533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.528401 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e7fa44-636d-424f-a5f4-eb6422251b9b" containerName="limitador" Jun 06 16:59:13.528533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.528414 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e7fa44-636d-424f-a5f4-eb6422251b9b" containerName="limitador" Jun 06 16:59:13.528533 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.528498 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e7fa44-636d-424f-a5f4-eb6422251b9b" containerName="limitador" Jun 06 16:59:13.532811 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.532792 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.535775 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.535741 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 06 16:59:13.535924 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.535786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-jrnxp\"" Jun 06 16:59:13.535924 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.535807 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 06 16:59:13.536987 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.536967 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 06 16:59:13.542157 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.542134 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n"] Jun 06 16:59:13.677803 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.677762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tthzq\" (UniqueName: \"kubernetes.io/projected/89e54338-1422-4ab2-b069-84ba5d21cd3c-kube-api-access-tthzq\") pod \"postgres-69fb4594cf-n2p9n\" (UID: \"89e54338-1422-4ab2-b069-84ba5d21cd3c\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.677992 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.677840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/89e54338-1422-4ab2-b069-84ba5d21cd3c-data\") pod \"postgres-69fb4594cf-n2p9n\" (UID: \"89e54338-1422-4ab2-b069-84ba5d21cd3c\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.778375 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.778284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/89e54338-1422-4ab2-b069-84ba5d21cd3c-data\") pod \"postgres-69fb4594cf-n2p9n\" (UID: \"89e54338-1422-4ab2-b069-84ba5d21cd3c\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.778555 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.778448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthzq\" (UniqueName: \"kubernetes.io/projected/89e54338-1422-4ab2-b069-84ba5d21cd3c-kube-api-access-tthzq\") pod \"postgres-69fb4594cf-n2p9n\" (UID: \"89e54338-1422-4ab2-b069-84ba5d21cd3c\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.778719 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.778700 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/89e54338-1422-4ab2-b069-84ba5d21cd3c-data\") pod \"postgres-69fb4594cf-n2p9n\" (UID: \"89e54338-1422-4ab2-b069-84ba5d21cd3c\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.786573 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.786547 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tthzq\" (UniqueName: \"kubernetes.io/projected/89e54338-1422-4ab2-b069-84ba5d21cd3c-kube-api-access-tthzq\") pod \"postgres-69fb4594cf-n2p9n\" (UID: \"89e54338-1422-4ab2-b069-84ba5d21cd3c\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.845122 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.845086 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:13.982075 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:13.982046 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n"] Jun 06 16:59:13.983863 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:59:13.983840 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e54338_1422_4ab2_b069_84ba5d21cd3c.slice/crio-9d92140f25047a277a32eb55979ace766c86633e54aa34dade646acfda0dde76 WatchSource:0}: Error finding container 9d92140f25047a277a32eb55979ace766c86633e54aa34dade646acfda0dde76: Status 404 returned error can't find the container with id 9d92140f25047a277a32eb55979ace766c86633e54aa34dade646acfda0dde76 Jun 06 16:59:14.925365 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:14.925283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" event={"ID":"89e54338-1422-4ab2-b069-84ba5d21cd3c","Type":"ContainerStarted","Data":"9d92140f25047a277a32eb55979ace766c86633e54aa34dade646acfda0dde76"} Jun 06 16:59:16.938987 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:16.938954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" event={"ID":"89e54338-1422-4ab2-b069-84ba5d21cd3c","Type":"ContainerStarted","Data":"539b6e9acfee2fff2abbff3f10dcff167b2fe42131a12a5eece857d7f705812a"} Jun 06 16:59:16.939365 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:16.939093 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:16.955417 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:16.955361 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" podStartSLOduration=1.199310532 podStartE2EDuration="3.95534544s" totalImagesPullingTime="2.756034908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:59:16.953427852 +0000 UTC m=+688.386265385" watchObservedRunningTime="2026-06-06 16:59:16.95534544 +0000 UTC m=+688.388182971" Jun 06 16:59:22.977783 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:22.977750 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-n2p9n" Jun 06 16:59:24.331650 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.331614 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c"] Jun 06 16:59:24.336912 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.336890 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.339748 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.339722 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 16:59:24.341243 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.341216 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 16:59:24.341373 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.341260 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wnlgj\"" Jun 06 16:59:24.343902 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.343875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c"] Jun 06 16:59:24.374796 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.374741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9dqs\" (UniqueName: \"kubernetes.io/projected/4145e324-e0f5-45ef-8615-65b1a2e2c671-kube-api-access-q9dqs\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.374992 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.374812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.374992 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.374867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.475773 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.475706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.475964 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.475793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.475964 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.475851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9dqs\" (UniqueName: \"kubernetes.io/projected/4145e324-e0f5-45ef-8615-65b1a2e2c671-kube-api-access-q9dqs\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.476140 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.476111 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.476178 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.476139 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.485148 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.485123 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9dqs\" (UniqueName: \"kubernetes.io/projected/4145e324-e0f5-45ef-8615-65b1a2e2c671-kube-api-access-q9dqs\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.647199 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.647096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:24.785422 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.785392 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c"] Jun 06 16:59:24.786870 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:59:24.786846 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4145e324_e0f5_45ef_8615_65b1a2e2c671.slice/crio-9dbd26e539c41c68a63a64a8e93d85d4a72fcb218be75f9fba370ed668154e44 WatchSource:0}: Error finding container 9dbd26e539c41c68a63a64a8e93d85d4a72fcb218be75f9fba370ed668154e44: Status 404 returned error can't find the container with id 9dbd26e539c41c68a63a64a8e93d85d4a72fcb218be75f9fba370ed668154e44 Jun 06 16:59:24.985150 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.985107 2572 generic.go:356] "Generic (PLEG): container finished" podID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerID="67e281592e7b39bd7815eba06c2761049cf9c184169e56f55cb0ef7322aead2b" exitCode=0 Jun 06 16:59:24.985339 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.985186 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" event={"ID":"4145e324-e0f5-45ef-8615-65b1a2e2c671","Type":"ContainerDied","Data":"67e281592e7b39bd7815eba06c2761049cf9c184169e56f55cb0ef7322aead2b"} Jun 06 16:59:24.985339 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:24.985277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" event={"ID":"4145e324-e0f5-45ef-8615-65b1a2e2c671","Type":"ContainerStarted","Data":"9dbd26e539c41c68a63a64a8e93d85d4a72fcb218be75f9fba370ed668154e44"} Jun 06 16:59:26.997912 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:26.997877 2572 generic.go:356] "Generic (PLEG): container finished" podID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerID="efc880bbe3f1c62d69bccfe79c8688842d8c6cb72edc3004c0fb82ff6c051fcd" exitCode=0 Jun 06 16:59:26.998314 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:26.997960 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" event={"ID":"4145e324-e0f5-45ef-8615-65b1a2e2c671","Type":"ContainerDied","Data":"efc880bbe3f1c62d69bccfe79c8688842d8c6cb72edc3004c0fb82ff6c051fcd"} Jun 06 16:59:28.005121 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:28.005079 2572 generic.go:356] "Generic (PLEG): container finished" podID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerID="6c6607a0b6dd5595bce0d904f50ced78d1f0fb5f154e199011769c248094dc5a" exitCode=0 Jun 06 16:59:28.005532 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:28.005141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" event={"ID":"4145e324-e0f5-45ef-8615-65b1a2e2c671","Type":"ContainerDied","Data":"6c6607a0b6dd5595bce0d904f50ced78d1f0fb5f154e199011769c248094dc5a"} Jun 06 16:59:29.145898 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.145870 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:29.219156 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.219109 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-bundle\") pod \"4145e324-e0f5-45ef-8615-65b1a2e2c671\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " Jun 06 16:59:29.219325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.219186 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-util\") pod \"4145e324-e0f5-45ef-8615-65b1a2e2c671\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " Jun 06 16:59:29.219325 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.219217 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9dqs\" (UniqueName: \"kubernetes.io/projected/4145e324-e0f5-45ef-8615-65b1a2e2c671-kube-api-access-q9dqs\") pod \"4145e324-e0f5-45ef-8615-65b1a2e2c671\" (UID: \"4145e324-e0f5-45ef-8615-65b1a2e2c671\") " Jun 06 16:59:29.219652 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.219625 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-bundle" (OuterVolumeSpecName: "bundle") pod "4145e324-e0f5-45ef-8615-65b1a2e2c671" (UID: "4145e324-e0f5-45ef-8615-65b1a2e2c671"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:59:29.221362 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.221315 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4145e324-e0f5-45ef-8615-65b1a2e2c671-kube-api-access-q9dqs" (OuterVolumeSpecName: "kube-api-access-q9dqs") pod "4145e324-e0f5-45ef-8615-65b1a2e2c671" (UID: "4145e324-e0f5-45ef-8615-65b1a2e2c671"). InnerVolumeSpecName "kube-api-access-q9dqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 16:59:29.224706 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.224665 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-util" (OuterVolumeSpecName: "util") pod "4145e324-e0f5-45ef-8615-65b1a2e2c671" (UID: "4145e324-e0f5-45ef-8615-65b1a2e2c671"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 16:59:29.320342 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.320247 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-util\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:59:29.320342 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.320281 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9dqs\" (UniqueName: \"kubernetes.io/projected/4145e324-e0f5-45ef-8615-65b1a2e2c671-kube-api-access-q9dqs\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:59:29.320342 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:29.320292 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4145e324-e0f5-45ef-8615-65b1a2e2c671-bundle\") on node \"ip-10-0-133-67.ec2.internal\" DevicePath \"\"" Jun 06 16:59:30.017040 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:30.017010 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" Jun 06 16:59:30.017188 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:30.017010 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q9l5c" event={"ID":"4145e324-e0f5-45ef-8615-65b1a2e2c671","Type":"ContainerDied","Data":"9dbd26e539c41c68a63a64a8e93d85d4a72fcb218be75f9fba370ed668154e44"} Jun 06 16:59:30.017188 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:30.017128 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dbd26e539c41c68a63a64a8e93d85d4a72fcb218be75f9fba370ed668154e44" Jun 06 16:59:37.169180 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169097 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bpwtc"] Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169508 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="util" Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169522 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="util" Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169532 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="extract" Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169538 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="extract" Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169549 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="pull" Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169554 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="pull" Jun 06 16:59:37.169682 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.169610 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4145e324-e0f5-45ef-8615-65b1a2e2c671" containerName="extract" Jun 06 16:59:37.172859 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.172842 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" Jun 06 16:59:37.175684 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.175662 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-hnl6m\"" Jun 06 16:59:37.175814 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.175705 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 16:59:37.177224 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.177199 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 16:59:37.181229 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.181208 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bpwtc"] Jun 06 16:59:37.289238 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.289204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq5jk\" (UniqueName: \"kubernetes.io/projected/835e4234-ca42-4654-afc2-f6c78d1f6dfd-kube-api-access-kq5jk\") pod \"keycloak-operator-d67dbbb48-bpwtc\" (UID: \"835e4234-ca42-4654-afc2-f6c78d1f6dfd\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" Jun 06 16:59:37.389841 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.389793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq5jk\" (UniqueName: \"kubernetes.io/projected/835e4234-ca42-4654-afc2-f6c78d1f6dfd-kube-api-access-kq5jk\") pod \"keycloak-operator-d67dbbb48-bpwtc\" (UID: \"835e4234-ca42-4654-afc2-f6c78d1f6dfd\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" Jun 06 16:59:37.398461 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.398406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq5jk\" (UniqueName: \"kubernetes.io/projected/835e4234-ca42-4654-afc2-f6c78d1f6dfd-kube-api-access-kq5jk\") pod \"keycloak-operator-d67dbbb48-bpwtc\" (UID: \"835e4234-ca42-4654-afc2-f6c78d1f6dfd\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" Jun 06 16:59:37.484839 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.484758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" Jun 06 16:59:37.616021 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:37.615997 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bpwtc"] Jun 06 16:59:37.618543 ip-10-0-133-67 kubenswrapper[2572]: W0606 16:59:37.618511 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835e4234_ca42_4654_afc2_f6c78d1f6dfd.slice/crio-78bf66d7a9d8e17ac53b2d78799cb39f1ff73504eefa1d4cfc4c7df81c563880 WatchSource:0}: Error finding container 78bf66d7a9d8e17ac53b2d78799cb39f1ff73504eefa1d4cfc4c7df81c563880: Status 404 returned error can't find the container with id 78bf66d7a9d8e17ac53b2d78799cb39f1ff73504eefa1d4cfc4c7df81c563880 Jun 06 16:59:38.057583 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:38.057549 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" event={"ID":"835e4234-ca42-4654-afc2-f6c78d1f6dfd","Type":"ContainerStarted","Data":"78bf66d7a9d8e17ac53b2d78799cb39f1ff73504eefa1d4cfc4c7df81c563880"} Jun 06 16:59:43.093283 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:43.093239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" event={"ID":"835e4234-ca42-4654-afc2-f6c78d1f6dfd","Type":"ContainerStarted","Data":"4008c07607ad25f606f4146cddb568be8ba1e44430edd3d1cc96f565d1f18fa9"} Jun 06 16:59:43.110543 ip-10-0-133-67 kubenswrapper[2572]: I0606 16:59:43.110481 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-bpwtc" podStartSLOduration=1.0969070890000001 podStartE2EDuration="6.110465506s" totalImagesPullingTime="5.013558417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 16:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 16:59:43.107952332 +0000 UTC m=+714.540789865" watchObservedRunningTime="2026-06-06 16:59:43.110465506 +0000 UTC m=+714.543303038" Jun 06 17:02:49.025112 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:02:49.025022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 17:02:49.028733 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:02:49.028713 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 17:05:07.641934 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.641893 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86b9f786fd-vbpt9"] Jun 06 17:05:07.645413 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.645394 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.649424 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.649404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 17:05:07.649542 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.649418 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 17:05:07.649542 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.649404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kk4wr\"" Jun 06 17:05:07.653989 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.653967 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-vbpt9"] Jun 06 17:05:07.758623 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.758583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wxxm\" (UniqueName: \"kubernetes.io/projected/1d08d251-cbf0-4d19-a2c8-f9da082233b4-kube-api-access-8wxxm\") pod \"maas-controller-86b9f786fd-vbpt9\" (UID: \"1d08d251-cbf0-4d19-a2c8-f9da082233b4\") " pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.758802 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.758634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08d251-cbf0-4d19-a2c8-f9da082233b4-webhook-cert\") pod \"maas-controller-86b9f786fd-vbpt9\" (UID: \"1d08d251-cbf0-4d19-a2c8-f9da082233b4\") " pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.860071 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.860032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wxxm\" (UniqueName: \"kubernetes.io/projected/1d08d251-cbf0-4d19-a2c8-f9da082233b4-kube-api-access-8wxxm\") pod \"maas-controller-86b9f786fd-vbpt9\" (UID: \"1d08d251-cbf0-4d19-a2c8-f9da082233b4\") " pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.860271 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.860089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08d251-cbf0-4d19-a2c8-f9da082233b4-webhook-cert\") pod \"maas-controller-86b9f786fd-vbpt9\" (UID: \"1d08d251-cbf0-4d19-a2c8-f9da082233b4\") " pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.862623 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.862595 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d08d251-cbf0-4d19-a2c8-f9da082233b4-webhook-cert\") pod \"maas-controller-86b9f786fd-vbpt9\" (UID: \"1d08d251-cbf0-4d19-a2c8-f9da082233b4\") " pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.868475 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.868425 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wxxm\" (UniqueName: \"kubernetes.io/projected/1d08d251-cbf0-4d19-a2c8-f9da082233b4-kube-api-access-8wxxm\") pod \"maas-controller-86b9f786fd-vbpt9\" (UID: \"1d08d251-cbf0-4d19-a2c8-f9da082233b4\") " pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:07.957946 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:07.957858 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:08.094098 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:08.094072 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86b9f786fd-vbpt9"] Jun 06 17:05:08.096126 ip-10-0-133-67 kubenswrapper[2572]: W0606 17:05:08.096090 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d08d251_cbf0_4d19_a2c8_f9da082233b4.slice/crio-006837db7623d0c207ad652874a8f8d8721b6f7811b29c616b10999b22e5c5a2 WatchSource:0}: Error finding container 006837db7623d0c207ad652874a8f8d8721b6f7811b29c616b10999b22e5c5a2: Status 404 returned error can't find the container with id 006837db7623d0c207ad652874a8f8d8721b6f7811b29c616b10999b22e5c5a2 Jun 06 17:05:08.097554 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:08.097534 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 17:05:08.752930 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:08.752880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" event={"ID":"1d08d251-cbf0-4d19-a2c8-f9da082233b4","Type":"ContainerStarted","Data":"006837db7623d0c207ad652874a8f8d8721b6f7811b29c616b10999b22e5c5a2"} Jun 06 17:05:10.764609 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:10.764519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" event={"ID":"1d08d251-cbf0-4d19-a2c8-f9da082233b4","Type":"ContainerStarted","Data":"6488f469df6ca510a27da357d99a733bc63b0d362cea6e241541fe95d74e0739"} Jun 06 17:05:10.764609 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:10.764589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:05:10.780811 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:10.780764 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" podStartSLOduration=1.372701577 podStartE2EDuration="3.780746319s" totalImagesPullingTime="2.408044742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 17:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:05:10.779891907 +0000 UTC m=+1042.212729440" watchObservedRunningTime="2026-06-06 17:05:10.780746319 +0000 UTC m=+1042.213583851" Jun 06 17:05:21.774808 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:05:21.774775 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86b9f786fd-vbpt9" Jun 06 17:07:49.056886 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:07:49.056850 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 17:07:49.061736 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:07:49.061716 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mc8c2_891ed2bc-6e19-4be9-ab63-52872c132ef9/ovn-acl-logging/0.log" Jun 06 17:08:11.883274 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:11.883249 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f6689757f-gsv5v_a675fad7-fa1a-4018-9c81-a25d58c3f82b/nginx/0.log" Jun 06 17:08:11.988299 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:11.988260 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qqfnp_69efe871-bd2d-44b5-8896-c0fc65ca47a7/manager/0.log" Jun 06 17:08:12.105585 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:12.105556 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fb2nc_2a0f4f08-5344-441a-a62d-d859662ef1b9/manager/0.log" Jun 06 17:08:12.226408 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:12.226333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86b9f786fd-vbpt9_1d08d251-cbf0-4d19-a2c8-f9da082233b4/manager/0.log" Jun 06 17:08:12.338812 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:12.338784 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9r5bt_a6d0302b-126c-4807-8df5-bf9451a45a21/server/0.log" Jun 06 17:08:12.446742 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:12.446712 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-q79j9_a21a7fb1-8006-4bde-a2a6-a87ffc872ab1/manager/0.log" Jun 06 17:08:12.794575 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:12.794546 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-zzjb9_c764fdba-10a8-452d-93d8-d10ead7ebcfd/copy-manifests/0.log" Jun 06 17:08:12.800862 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:12.800844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-zzjb9_c764fdba-10a8-452d-93d8-d10ead7ebcfd/manager/0.log" Jun 06 17:08:14.841952 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:14.841922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6jr6r_4516593e-c378-496b-babe-fe5e436a8c96/manager/0.log" Jun 06 17:08:15.311568 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:15.311534 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8w96t_8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f/discovery/0.log" Jun 06 17:08:15.527212 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:15.527182 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f5b7f78f5-k2p6p_a77316a2-462a-4545-bf96-82b3fc3e5c86/kube-auth-proxy/0.log" Jun 06 17:08:24.053588 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:24.053552 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-642vt_0c5c6797-1b7e-4094-9dbe-454cde02bf5c/global-pull-secret-syncer/0.log" Jun 06 17:08:24.192280 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:24.192240 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9sm4t_4db59a34-eee8-46a6-badf-618c23f3f3a1/konnectivity-agent/0.log" Jun 06 17:08:24.261162 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:24.261128 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-67.ec2.internal_0b77a3d35a85da5c6ed251539a21fda5/haproxy/0.log" Jun 06 17:08:28.337746 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:28.337710 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-w4cdr_d97ba97e-0ae6-4853-ae24-77ef89ce7237/sail-operator/0.log" Jun 06 17:08:29.623968 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:29.623929 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6jr6r_4516593e-c378-496b-babe-fe5e436a8c96/manager/0.log" Jun 06 17:08:31.812503 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:31.812476 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q8zcf_37fda115-8a33-444b-8cf4-89028fd67197/node-exporter/0.log" Jun 06 17:08:31.832235 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:31.832213 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q8zcf_37fda115-8a33-444b-8cf4-89028fd67197/kube-rbac-proxy/0.log" Jun 06 17:08:31.851834 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:31.851814 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q8zcf_37fda115-8a33-444b-8cf4-89028fd67197/init-textfile/0.log" Jun 06 17:08:32.206093 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.206014 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wp4jw_3f004063-e294-42d1-8f6e-8a73280a9d26/prometheus-operator/0.log" Jun 06 17:08:32.250458 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.250405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wp4jw_3f004063-e294-42d1-8f6e-8a73280a9d26/kube-rbac-proxy/0.log" Jun 06 17:08:32.430547 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.430519 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd7fbdcd4-46p6k_7ce94afd-8ad0-4058-bcc7-b1900d22a194/thanos-query/0.log" Jun 06 17:08:32.454184 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.454153 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd7fbdcd4-46p6k_7ce94afd-8ad0-4058-bcc7-b1900d22a194/kube-rbac-proxy-web/0.log" Jun 06 17:08:32.495409 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.495384 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd7fbdcd4-46p6k_7ce94afd-8ad0-4058-bcc7-b1900d22a194/kube-rbac-proxy/0.log" Jun 06 17:08:32.515079 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.515054 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd7fbdcd4-46p6k_7ce94afd-8ad0-4058-bcc7-b1900d22a194/prom-label-proxy/0.log" Jun 06 17:08:32.534627 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.534593 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd7fbdcd4-46p6k_7ce94afd-8ad0-4058-bcc7-b1900d22a194/kube-rbac-proxy-rules/0.log" Jun 06 17:08:32.554824 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:32.554798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd7fbdcd4-46p6k_7ce94afd-8ad0-4058-bcc7-b1900d22a194/kube-rbac-proxy-metrics/0.log" Jun 06 17:08:34.724962 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.724927 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6"] Jun 06 17:08:34.728552 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.728532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.731019 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.730997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2kw2l\"/\"kube-root-ca.crt\"" Jun 06 17:08:34.731123 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.730997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2kw2l\"/\"openshift-service-ca.crt\"" Jun 06 17:08:34.732299 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.732243 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2kw2l\"/\"default-dockercfg-f7654\"" Jun 06 17:08:34.735536 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.735473 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6"] Jun 06 17:08:34.854151 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.854118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-podres\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.854151 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.854164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-lib-modules\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.854408 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.854243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-proc\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.854408 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.854324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-sys\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.854408 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.854367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2ch\" (UniqueName: \"kubernetes.io/projected/78eeb02c-ab38-403f-a527-d924b6edba1d-kube-api-access-lz2ch\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.898188 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.898157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ddb698c84-qsjqn_8cf9c75f-67da-4611-826b-fd07a07ab03f/console/0.log" Jun 06 17:08:34.955626 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-podres\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955806 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-lib-modules\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955806 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955674 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-proc\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955806 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-sys\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955806 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2ch\" (UniqueName: \"kubernetes.io/projected/78eeb02c-ab38-403f-a527-d924b6edba1d-kube-api-access-lz2ch\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955806 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955785 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-lib-modules\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955981 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955809 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-proc\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955981 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-podres\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.955981 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.955822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78eeb02c-ab38-403f-a527-d924b6edba1d-sys\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:34.963352 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:34.963322 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2ch\" (UniqueName: \"kubernetes.io/projected/78eeb02c-ab38-403f-a527-d924b6edba1d-kube-api-access-lz2ch\") pod \"perf-node-gather-daemonset-2wsg6\" (UID: \"78eeb02c-ab38-403f-a527-d924b6edba1d\") " pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:35.039952 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:35.039914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:35.175140 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:35.175113 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6"] Jun 06 17:08:35.177264 ip-10-0-133-67 kubenswrapper[2572]: W0606 17:08:35.177238 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod78eeb02c_ab38_403f_a527_d924b6edba1d.slice/crio-bfccb3f06463c867a6559bbc2e8a320a83b64198e615f3051da56f5cc572eba5 WatchSource:0}: Error finding container bfccb3f06463c867a6559bbc2e8a320a83b64198e615f3051da56f5cc572eba5: Status 404 returned error can't find the container with id bfccb3f06463c867a6559bbc2e8a320a83b64198e615f3051da56f5cc572eba5 Jun 06 17:08:35.820873 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:35.820832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" event={"ID":"78eeb02c-ab38-403f-a527-d924b6edba1d","Type":"ContainerStarted","Data":"d78dc6eaba5d3d9bfeac3c7120174a4adb3d917b15f12d0a52e922c5f2d3029e"} Jun 06 17:08:35.821252 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:35.820901 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:35.821252 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:35.820928 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" event={"ID":"78eeb02c-ab38-403f-a527-d924b6edba1d","Type":"ContainerStarted","Data":"bfccb3f06463c867a6559bbc2e8a320a83b64198e615f3051da56f5cc572eba5"} Jun 06 17:08:35.835983 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:35.835932 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" podStartSLOduration=1.835916712 podStartE2EDuration="1.835916712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 17:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 17:08:35.835469077 +0000 UTC m=+1247.268306606" watchObservedRunningTime="2026-06-06 17:08:35.835916712 +0000 UTC m=+1247.268754243" Jun 06 17:08:36.779661 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:36.779576 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmh7j_f7289393-072f-4fa7-98ea-dcb6eb7c9614/dns/0.log" Jun 06 17:08:36.799863 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:36.799834 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmh7j_f7289393-072f-4fa7-98ea-dcb6eb7c9614/kube-rbac-proxy/0.log" Jun 06 17:08:36.871638 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:36.871611 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96bcr_c9bedaf8-c988-4514-b190-1cce9f971446/dns-node-resolver/0.log" Jun 06 17:08:37.435864 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:37.435832 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-787c4494db-gnp2r_b23647cf-9dfa-4cf6-8b07-e205e4612659/registry/0.log" Jun 06 17:08:37.439394 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:37.439371 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-787c4494db-gnp2r_b23647cf-9dfa-4cf6-8b07-e205e4612659/registry/1.log" Jun 06 17:08:37.461276 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:37.461251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bshh4_bb76a589-8bc2-4d18-9930-a9faaf997801/node-ca/0.log" Jun 06 17:08:38.503043 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:38.503017 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8w96t_8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f/discovery/0.log" Jun 06 17:08:38.545409 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:38.545379 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f5b7f78f5-k2p6p_a77316a2-462a-4545-bf96-82b3fc3e5c86/kube-auth-proxy/0.log" Jun 06 17:08:39.314661 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:39.314627 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7vqmt_854d87df-39cd-4497-9d16-f4939fff2982/serve-healthcheck-canary/0.log" Jun 06 17:08:40.037836 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:40.037810 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbb75_d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8/kube-rbac-proxy/0.log" Jun 06 17:08:40.058469 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:40.058428 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbb75_d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8/exporter/0.log" Jun 06 17:08:40.079559 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:40.079536 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbb75_d2f1a5ba-f3db-433f-bf40-1522c0c4b5f8/extractor/0.log" Jun 06 17:08:41.836161 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:41.836135 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2kw2l/perf-node-gather-daemonset-2wsg6" Jun 06 17:08:42.237409 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.237380 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f6689757f-gsv5v_a675fad7-fa1a-4018-9c81-a25d58c3f82b/nginx/0.log" Jun 06 17:08:42.260381 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.260356 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qqfnp_69efe871-bd2d-44b5-8896-c0fc65ca47a7/manager/0.log" Jun 06 17:08:42.308218 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.308192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fb2nc_2a0f4f08-5344-441a-a62d-d859662ef1b9/manager/0.log" Jun 06 17:08:42.332271 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.332242 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86b9f786fd-vbpt9_1d08d251-cbf0-4d19-a2c8-f9da082233b4/manager/0.log" Jun 06 17:08:42.350210 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.350186 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9r5bt_a6d0302b-126c-4807-8df5-bf9451a45a21/server/0.log" Jun 06 17:08:42.397537 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.397508 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-q79j9_a21a7fb1-8006-4bde-a2a6-a87ffc872ab1/manager/0.log" Jun 06 17:08:42.550407 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.550324 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-zzjb9_c764fdba-10a8-452d-93d8-d10ead7ebcfd/manager/0.log" Jun 06 17:08:42.569935 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:42.569911 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bd68968c-zzjb9_c764fdba-10a8-452d-93d8-d10ead7ebcfd/copy-manifests/0.log" Jun 06 17:08:44.277739 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:44.277707 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ndlzk_d7c6e40a-136a-4a77-80f5-68013a3a9e42/openshift-lws-operator/0.log" Jun 06 17:08:48.772898 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:48.772864 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8w96t_8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f/discovery/0.log" Jun 06 17:08:48.797866 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:48.797841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f5b7f78f5-k2p6p_a77316a2-462a-4545-bf96-82b3fc3e5c86/kube-auth-proxy/0.log" Jun 06 17:08:50.022960 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:50.022921 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8w96t_8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f/discovery/0.log" Jun 06 17:08:50.051206 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:50.051176 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f5b7f78f5-k2p6p_a77316a2-462a-4545-bf96-82b3fc3e5c86/kube-auth-proxy/0.log" Jun 06 17:08:51.271091 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.271065 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/kube-multus-additional-cni-plugins/0.log" Jun 06 17:08:51.290927 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.290904 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/egress-router-binary-copy/0.log" Jun 06 17:08:51.310953 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.310923 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/cni-plugins/0.log" Jun 06 17:08:51.331166 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.331141 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/bond-cni-plugin/0.log" Jun 06 17:08:51.353234 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.353212 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/routeoverride-cni/0.log" Jun 06 17:08:51.376444 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.376417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/whereabouts-cni-bincopy/0.log" Jun 06 17:08:51.399057 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.399030 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgk68_85a9f767-0b05-4ebf-a348-cc02ea89adb4/whereabouts-cni/0.log" Jun 06 17:08:51.428403 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.428370 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p7wtb_41092481-72ad-4ed6-ac52-65c06c04d5bb/kube-multus/0.log" Jun 06 17:08:51.564317 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.564231 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-shnng_e3f336c0-4fa1-4d84-844d-c76e88c994b7/network-metrics-daemon/0.log" Jun 06 17:08:51.582513 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.582471 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-shnng_e3f336c0-4fa1-4d84-844d-c76e88c994b7/kube-rbac-proxy/0.log" Jun 06 17:08:51.721992 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.721959 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8w96t_8b1c9505-0c3c-4aa7-bba4-0c048e7ca73f/discovery/0.log" Jun 06 17:08:51.745807 ip-10-0-133-67 kubenswrapper[2572]: I0606 17:08:51.745780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f5b7f78f5-k2p6p_a77316a2-462a-4545-bf96-82b3fc3e5c86/kube-auth-proxy/0.log"