Jun 05 12:58:22.002382 ip-10-0-132-150 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 12:58:22.002393 ip-10-0-132-150 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 12:58:22.002400 ip-10-0-132-150 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 12:58:22.002545 ip-10-0-132-150 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 12:58:32.142062 ip-10-0-132-150 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 12:58:32.142079 ip-10-0-132-150 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 582de852b55043d98fe8e179dc3d0eb7 -- Jun 05 13:01:05.184406 ip-10-0-132-150 systemd[1]: Starting Kubernetes Kubelet... Jun 05 13:01:05.609775 ip-10-0-132-150 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:01:05.609775 ip-10-0-132-150 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 13:01:05.609775 ip-10-0-132-150 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:01:05.609775 ip-10-0-132-150 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 13:01:05.609775 ip-10-0-132-150 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:01:05.612419 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.612322 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 13:01:05.618464 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618442 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:05.618464 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618459 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:05.618464 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618464 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:05.618464 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618468 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:05.618464 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618470 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618474 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618478 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618481 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618483 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618486 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618489 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618493 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618495 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618498 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618501 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618503 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618510 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618513 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618516 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618518 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618521 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618523 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618526 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618529 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:05.618655 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618531 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618536 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618540 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618543 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618546 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618549 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618553 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618555 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618560 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618563 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618566 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618569 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618572 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618575 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618578 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618580 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618583 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618586 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618588 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618591 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:05.619185 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618593 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618596 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618599 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618602 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618604 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618608 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618611 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618613 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618616 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618618 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618621 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618623 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618626 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618629 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618631 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618633 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618636 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618638 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618641 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618644 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:05.619775 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618646 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618649 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618652 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618654 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618658 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618661 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618664 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618667 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618670 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618672 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618676 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618679 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618683 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618686 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618689 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618691 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618694 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618696 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618699 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:05.620535 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618702 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618705 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618707 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618710 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618712 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618715 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618717 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618720 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618722 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618724 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618727 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618730 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618732 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618735 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618739 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.618743 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620232 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620253 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620260 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620265 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:05.621080 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620270 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620275 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620280 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620284 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620289 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620293 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620303 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620308 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620312 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620316 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620320 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620324 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620329 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620333 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620337 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620341 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620345 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620349 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620358 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620362 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:05.621598 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620366 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620370 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620374 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620380 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620384 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620388 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620393 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620397 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620401 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620407 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620415 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620420 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620424 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620428 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620433 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620461 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620477 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620483 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620488 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620493 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:05.622119 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620498 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620503 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620507 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620511 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620516 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620521 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620525 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620530 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620538 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620542 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620570 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620574 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620577 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620580 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620596 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620599 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620719 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620725 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620728 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620731 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:05.622627 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620734 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620736 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620739 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620741 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620744 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620750 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620754 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620758 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620761 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620764 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620770 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620774 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620777 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620780 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620783 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620786 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620789 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620792 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620796 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:05.623121 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620799 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620802 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620806 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620808 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620811 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620814 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620817 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620821 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620850 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620854 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620857 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620860 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620864 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620867 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620870 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.620872 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621297 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621303 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621306 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:05.623600 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621309 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621313 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621317 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621320 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621323 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621326 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621329 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621332 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621334 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621337 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621339 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621342 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621344 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621347 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621350 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621353 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621356 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621358 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621361 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621363 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:05.624075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621367 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621371 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621374 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621377 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621379 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621382 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621384 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621387 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621390 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621392 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621395 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621397 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621400 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621402 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621405 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621408 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621410 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621413 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621416 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621418 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:05.624592 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621421 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621423 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621426 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621428 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621431 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621434 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621437 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621440 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621444 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621447 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621450 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621453 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621456 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621458 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621461 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621464 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621467 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621470 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621473 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:05.625114 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621476 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621479 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621482 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621485 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621487 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621490 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621494 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621498 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621501 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621504 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621507 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621510 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621512 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621515 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621517 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621520 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621522 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621525 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621527 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621530 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:05.625584 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621533 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621535 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621538 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621540 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621543 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621545 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621548 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621550 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621553 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621555 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621558 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621560 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621562 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621565 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621567 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621570 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.621572 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621652 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621659 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621666 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621671 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 13:01:05.626075 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621675 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621678 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621682 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621687 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621690 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621693 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621696 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621700 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621703 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621706 2558 flags.go:64] FLAG: --cgroup-root="" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621709 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621712 2558 flags.go:64] FLAG: --client-ca-file="" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621715 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621718 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621722 2558 flags.go:64] FLAG: --cluster-domain="" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621724 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621727 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621730 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621734 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621743 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621746 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621749 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621752 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621755 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 05 13:01:05.626596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621758 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621761 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621764 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621767 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621771 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621775 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621778 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621781 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621784 2558 flags.go:64] FLAG: --enable-server="true" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621786 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621791 2558 flags.go:64] FLAG: --event-burst="100" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621794 2558 flags.go:64] FLAG: --event-qps="50" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621797 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621800 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621803 2558 flags.go:64] FLAG: --eviction-hard="" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621807 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621810 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621812 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621815 2558 flags.go:64] FLAG: --eviction-soft="" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621818 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621821 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621825 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621827 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621830 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621833 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 13:01:05.627190 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621836 2558 flags.go:64] FLAG: --feature-gates="" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621840 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621843 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621845 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621849 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621852 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621854 2558 flags.go:64] FLAG: --help="false" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621858 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621865 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621868 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621870 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621874 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621877 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621880 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621883 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621886 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621889 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621896 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621899 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621902 2558 flags.go:64] FLAG: --kube-reserved="" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621905 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621908 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621911 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621914 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 13:01:05.627843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621916 2558 flags.go:64] FLAG: --lock-file="" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621919 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621922 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621926 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621931 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621934 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621937 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621940 2558 flags.go:64] FLAG: --logging-format="text" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621943 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621946 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621949 2558 flags.go:64] FLAG: --manifest-url="" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621951 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621964 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621967 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621971 2558 flags.go:64] FLAG: --max-pods="110" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621974 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621979 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621981 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621984 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621987 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621990 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.621993 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622000 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622003 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622007 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 13:01:05.628461 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622010 2558 flags.go:64] FLAG: --pod-cidr="" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622012 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622017 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622020 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622024 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622026 2558 flags.go:64] FLAG: --port="10250" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622030 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622032 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-035d2f71756c5de79" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622036 2558 flags.go:64] FLAG: --qos-reserved="" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622039 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622041 2558 flags.go:64] FLAG: --register-node="true" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622044 2558 flags.go:64] FLAG: --register-with-taints="" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622048 2558 flags.go:64] FLAG: --registry-burst="10" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622052 2558 flags.go:64] FLAG: --registry-qps="5" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622055 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622058 2558 flags.go:64] FLAG: --reserved-memory="" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622061 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622065 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622068 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622070 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622073 2558 flags.go:64] FLAG: --runonce="false" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622076 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622079 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622083 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622087 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 13:01:05.629144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622089 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622092 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622096 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622112 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622116 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622119 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622122 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622125 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622128 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622131 2558 flags.go:64] FLAG: --system-cgroups="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622134 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622139 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622142 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622145 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622149 2558 flags.go:64] FLAG: --tls-min-version="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622152 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622154 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622157 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622160 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622165 2558 flags.go:64] FLAG: --v="2" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622169 2558 flags.go:64] FLAG: --version="false" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622174 2558 flags.go:64] FLAG: --vmodule="" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622177 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.622181 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622302 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:05.629769 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622306 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622309 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622312 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622315 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622318 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622320 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622324 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622327 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622329 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622332 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622334 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622337 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622339 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622342 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622345 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622347 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622350 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622353 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622355 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622358 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:05.630449 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622361 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622364 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622366 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622369 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622371 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622374 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622377 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622380 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622382 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622386 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622388 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622391 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622393 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622396 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622398 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622401 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622404 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622406 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622410 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622412 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:05.630941 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622415 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622417 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622420 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622422 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622425 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622428 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622430 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622433 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622436 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622438 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622441 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622443 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622446 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622449 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622451 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622453 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622456 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622458 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622465 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622468 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:05.631458 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622470 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622473 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622476 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622478 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622481 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622484 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622486 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622488 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622491 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622494 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622498 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622500 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622503 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622505 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622509 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622513 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622516 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622519 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622522 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:05.631957 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622525 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622528 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622532 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622535 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622538 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622540 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622543 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622546 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622548 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622550 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622553 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622556 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622559 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622563 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622566 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622569 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622573 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622575 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:05.632448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.622578 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.623159 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.630464 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.630482 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.630503 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.630513 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630568 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630574 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630577 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630580 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630584 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630587 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630590 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630593 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:05.632886 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630596 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630599 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630602 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630604 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630607 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630609 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630612 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630615 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630617 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630620 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630623 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630626 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630629 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630631 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630634 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630637 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630639 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630642 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630644 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630647 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:05.633255 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630650 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630654 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630658 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630662 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630665 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630668 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630671 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630673 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630676 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630678 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630681 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630683 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630686 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630688 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630691 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630693 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630696 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630699 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630701 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:05.633807 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630704 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630708 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630711 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630715 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630718 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630720 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630723 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630726 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630729 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630732 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630735 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630737 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630740 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630743 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630746 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630751 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630753 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630756 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630759 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630761 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:05.634308 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630764 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630766 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630769 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630771 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630774 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630776 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630779 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630782 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630784 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630787 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630789 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630791 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630795 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630797 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630800 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630802 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630805 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630807 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630810 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630812 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:05.634834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630815 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630817 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630821 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630823 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630826 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630829 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630831 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630834 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630838 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630840 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630843 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630847 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.630852 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630969 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630973 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:05.635367 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630976 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630979 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630982 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630984 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630987 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630989 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630992 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630996 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.630998 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631001 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631004 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631006 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631009 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631011 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631014 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631016 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631019 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631021 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631024 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631026 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:05.635777 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631029 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631032 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631035 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631037 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631040 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631042 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631046 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631048 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631051 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631053 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631056 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631058 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631061 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631063 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631066 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631068 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631071 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631073 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631076 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631080 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:05.636282 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631084 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631087 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631090 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631093 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631095 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631117 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631120 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631123 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631126 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631129 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631132 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631135 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631139 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631142 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631145 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631148 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631151 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631153 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631156 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:05.636771 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631159 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631162 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631164 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631167 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631169 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631172 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631175 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631177 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631180 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631182 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631185 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631187 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631190 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631193 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631195 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631198 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631200 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631203 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631206 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:05.637338 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631208 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631210 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631213 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631216 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631218 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631220 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631223 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631225 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631228 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631231 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631234 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631236 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631239 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631241 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631244 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631248 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631251 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631254 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:05.637834 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:05.631257 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.631262 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.631375 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.633377 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.634706 2558 server.go:1019] "Starting client certificate rotation" Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.634822 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.636852 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:01:05.638321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.637993 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:01:05.640996 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.640976 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:01:05.653537 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.653522 2558 log.go:25] "Validated CRI v1 runtime API" Jun 05 13:01:05.656226 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.656211 2558 log.go:25] "Validated CRI v1 image API" Jun 05 13:01:05.657694 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.657678 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 13:01:05.661129 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.661094 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94477689-3574-4166-8a9a-5de41e4ef0bf:/dev/nvme0n1p3 e62dd5ef-64e6-415c-8cbf-dd1111aefde9:/dev/nvme0n1p4] Jun 05 13:01:05.661211 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.661129 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 13:01:05.662803 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.662788 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:01:05.667330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.667221 2558 manager.go:216] Machine: {Timestamp:2026-06-05 13:01:05.665841971 +0000 UTC m=+0.357354937 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100435 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f97578977f4d6450934187e7cf4e8 SystemUUID:ec2f9757-8977-f4d6-4509-34187e7cf4e8 BootID:582de852-b550-43d9-8fe8-e179dc3d0eb7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:f3:5d:c1:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:f3:5d:c1:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:04:79:6e:c3:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 13:01:05.667330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.667327 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 13:01:05.667429 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.667405 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 13:01:05.670785 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.670760 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 13:01:05.670918 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.670788 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-150.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 13:01:05.672401 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.672390 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 13:01:05.672440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.672403 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 13:01:05.672440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.672411 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:01:05.673126 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.673115 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:01:05.673869 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.673859 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 13:01:05.677164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677154 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:01:05.677280 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677271 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 13:01:05.677311 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677307 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 05 13:01:05.677344 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677321 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 13:01:05.677344 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677336 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 13:01:05.677406 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677346 2558 kubelet.go:398] "Adding apiserver pod source" Jun 05 13:01:05.677406 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677354 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 13:01:05.677760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677750 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:01:05.677808 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.677767 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:01:05.679895 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.679879 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 13:01:05.682211 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.682198 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 13:01:05.682262 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.682230 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 13:01:05.683469 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683457 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 13:01:05.683516 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683477 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 13:01:05.683516 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683487 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 13:01:05.683516 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683495 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 13:01:05.683516 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683508 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 13:01:05.683516 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683515 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683561 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683567 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683574 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683580 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683593 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683602 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683626 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 13:01:05.683686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683633 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 13:01:05.683946 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.683908 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xw6lg" Jun 05 13:01:05.686918 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.686907 2558 server.go:1268] "Started kubelet" Jun 05 13:01:05.687061 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.687023 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 13:01:05.687638 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.687589 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-150.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:01:05.687765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.686989 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 13:01:05.687863 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.687802 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 13:01:05.687933 ip-10-0-132-150 systemd[1]: Started Kubernetes Kubelet. Jun 05 13:01:05.688511 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.687932 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:01:05.688511 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.687934 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:01:05.689536 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.689519 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 13:01:05.689918 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.689904 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 05 13:01:05.691376 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.691359 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xw6lg" Jun 05 13:01:05.695029 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.695007 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 13:01:05.695132 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.695004 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 13:01:05.695620 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.695574 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:05.696016 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.695994 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 13:01:05.696016 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696018 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 13:01:05.696172 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696162 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 13:01:05.696286 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696276 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 05 13:01:05.696317 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696288 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 05 13:01:05.696348 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696332 2558 factory.go:55] Registering systemd factory Jun 05 13:01:05.696348 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696347 2558 factory.go:223] Registration of the systemd container factory successfully Jun 05 13:01:05.696786 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696765 2558 factory.go:153] Registering CRI-O factory Jun 05 13:01:05.696876 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696791 2558 factory.go:223] Registration of the crio container factory successfully Jun 05 13:01:05.696876 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.692010 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-150.ec2.internal.18b630e5ad6d5b1e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-150.ec2.internal,UID:ip-10-0-132-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-150.ec2.internal,},FirstTimestamp:2026-06-05 13:01:05.686879006 +0000 UTC m=+0.378391972,LastTimestamp:2026-06-05 13:01:05.686879006 +0000 UTC m=+0.378391972,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-150.ec2.internal,}" Jun 05 13:01:05.696876 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.696806 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 13:01:05.696876 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696870 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 13:01:05.697077 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696890 2558 factory.go:103] Registering Raw factory Jun 05 13:01:05.697077 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.696905 2558 manager.go:1196] Started watching for new ooms in manager Jun 05 13:01:05.698296 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.698278 2558 manager.go:349] Starting recovery of all containers Jun 05 13:01:05.707763 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.707599 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:05.708910 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.708895 2558 manager.go:354] Recovery completed Jun 05 13:01:05.711239 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.711221 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-150.ec2.internal\" not found" node="ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.714260 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.714247 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.716048 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716027 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.716127 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716060 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.716127 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716070 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.716613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716599 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 13:01:05.716613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716611 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 13:01:05.716718 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716628 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:01:05.716718 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.716613 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.717343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.717327 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.717431 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.717357 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.717431 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.717371 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.717724 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.717710 2558 policy_none.go:49] "None policy: Start" Jun 05 13:01:05.717768 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.717727 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 13:01:05.717768 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.717737 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 13:01:05.719604 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.719593 2558 policy_none.go:47] "Start" Jun 05 13:01:05.750652 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.750638 2558 manager.go:337] "Starting Device Plugin manager" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.750671 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.750681 2558 server.go:87] "Starting device plugin registration server" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.750920 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.750934 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.750998 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.751073 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.751133 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.751750 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.751803 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.756832 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.758023 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.758058 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.758078 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.758129 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 13:01:05.761036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.760653 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:05.851256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.851232 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.852229 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.852207 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.852332 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.852246 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.852332 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.852260 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.852332 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.852283 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.858620 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.858603 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.858697 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.858626 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-150.ec2.internal\": node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:05.858740 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.858702 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal"] Jun 05 13:01:05.858779 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.858767 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.859621 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.859606 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.859686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.859635 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.859686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.859644 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.860999 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.860955 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.861096 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861081 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.861182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861166 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.861679 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861663 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.861756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861681 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.861756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861690 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.861756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861706 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.861756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861727 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.861876 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.861760 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.863907 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.863371 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.863907 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.863408 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:05.864620 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.864602 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:05.864699 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.864635 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:05.864699 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.864649 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:05.873358 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.873340 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:05.892765 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.892746 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-150.ec2.internal\" not found" node="ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.897144 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.897129 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-150.ec2.internal\" not found" node="ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.897214 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.897166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70e51b6f7a224f28138ba1bcd816eda-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"e70e51b6f7a224f28138ba1bcd816eda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.897214 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.897187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/559b7c555df026f06f2605e41632946e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-150.ec2.internal\" (UID: \"559b7c555df026f06f2605e41632946e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.897214 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.897207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e70e51b6f7a224f28138ba1bcd816eda-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"e70e51b6f7a224f28138ba1bcd816eda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.974174 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:05.974144 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:05.997334 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.997309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e70e51b6f7a224f28138ba1bcd816eda-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"e70e51b6f7a224f28138ba1bcd816eda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.997472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.997339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70e51b6f7a224f28138ba1bcd816eda-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"e70e51b6f7a224f28138ba1bcd816eda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.997472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.997354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/559b7c555df026f06f2605e41632946e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-150.ec2.internal\" (UID: \"559b7c555df026f06f2605e41632946e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.997472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.997411 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70e51b6f7a224f28138ba1bcd816eda-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"e70e51b6f7a224f28138ba1bcd816eda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.997472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.997417 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e70e51b6f7a224f28138ba1bcd816eda-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal\" (UID: \"e70e51b6f7a224f28138ba1bcd816eda\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:05.997472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:05.997464 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/559b7c555df026f06f2605e41632946e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-150.ec2.internal\" (UID: \"559b7c555df026f06f2605e41632946e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jun 05 13:01:06.074532 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.074502 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.175146 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.175052 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.197455 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.197427 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:06.202008 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.201993 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jun 05 13:01:06.275999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.275958 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.376487 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.376453 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.477019 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.476938 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.577457 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.577419 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.584330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.584313 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:06.633808 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.633778 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 13:01:06.634424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.633924 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:01:06.634424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.633954 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:01:06.634424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.633961 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:01:06.676847 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:06.676813 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559b7c555df026f06f2605e41632946e.slice/crio-ddc309c51965df7ac054a12b24f2a7e75b2eb74b137fe30dc9f6d70265017f5b WatchSource:0}: Error finding container ddc309c51965df7ac054a12b24f2a7e75b2eb74b137fe30dc9f6d70265017f5b: Status 404 returned error can't find the container with id ddc309c51965df7ac054a12b24f2a7e75b2eb74b137fe30dc9f6d70265017f5b Jun 05 13:01:06.677165 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:06.677141 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70e51b6f7a224f28138ba1bcd816eda.slice/crio-0005fa8bd6a2e4d025251438a674fea443d1c9f3bb3c7cd8a362d1069b7a9dc1 WatchSource:0}: Error finding container 0005fa8bd6a2e4d025251438a674fea443d1c9f3bb3c7cd8a362d1069b7a9dc1: Status 404 returned error can't find the container with id 0005fa8bd6a2e4d025251438a674fea443d1c9f3bb3c7cd8a362d1069b7a9dc1 Jun 05 13:01:06.678234 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.678208 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.682875 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.682858 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:01:06.698113 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.698067 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 12:56:05 +0000 UTC" deadline="2028-02-28 07:49:49.23768821 +0000 UTC" Jun 05 13:01:06.698113 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.698095 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15186h48m42.539596649s" Jun 05 13:01:06.761883 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.761786 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" event={"ID":"559b7c555df026f06f2605e41632946e","Type":"ContainerStarted","Data":"ddc309c51965df7ac054a12b24f2a7e75b2eb74b137fe30dc9f6d70265017f5b"} Jun 05 13:01:06.762814 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.762796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"e70e51b6f7a224f28138ba1bcd816eda","Type":"ContainerStarted","Data":"0005fa8bd6a2e4d025251438a674fea443d1c9f3bb3c7cd8a362d1069b7a9dc1"} Jun 05 13:01:06.778943 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.778919 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.879412 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:06.879380 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-150.ec2.internal\" not found" Jun 05 13:01:06.921112 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.921081 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:06.996765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:06.996738 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" Jun 05 13:01:07.006873 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.006850 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:01:07.007996 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.007980 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" Jun 05 13:01:07.014119 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.014064 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:01:07.678393 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.678357 2558 apiserver.go:52] "Watching apiserver" Jun 05 13:01:07.684847 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.684821 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 13:01:07.686219 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.686189 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt","openshift-cluster-node-tuning-operator/tuned-9m5c4","openshift-dns/node-resolver-l6mbd","openshift-multus/multus-additional-cni-plugins-8p2mk","openshift-ovn-kubernetes/ovnkube-node-g5l2w","kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal","openshift-image-registry/node-ca-nr54c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal","openshift-multus/multus-pknj9","openshift-multus/network-metrics-daemon-gnlk6","openshift-network-diagnostics/network-check-target-55hcn","openshift-network-operator/iptables-alerter-64g9n","kube-system/global-pull-secret-syncer-92c4b","kube-system/konnectivity-agent-82n4t"] Jun 05 13:01:07.687803 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.687784 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.689046 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.689026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:07.689148 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.689116 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:07.690182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.690164 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.690635 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.690602 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d58tq\"" Jun 05 13:01:07.690943 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.690798 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.690943 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.690811 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.690943 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.690819 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 13:01:07.691429 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.691408 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.693076 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.693042 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.693182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.693126 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.693798 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.693480 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5nmj\"" Jun 05 13:01:07.693798 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.693569 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 13:01:07.693798 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.693665 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 13:01:07.694008 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.693828 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.694063 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.694023 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 13:01:07.695187 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.694256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xxpx7\"" Jun 05 13:01:07.695187 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.694400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.695187 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.694638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.695644 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.695623 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.696744 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.696838 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.696909 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.696933 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.697419 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.697549 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.697611 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-znxj5\"" Jun 05 13:01:07.697807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.697789 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.698924 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.698858 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 13:01:07.699022 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.699011 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-24q2x\"" Jun 05 13:01:07.699085 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.699030 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.699163 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.699131 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 13:01:07.700339 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.700317 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.700868 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.700846 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 13:01:07.700965 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.700929 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rw8mm\"" Jun 05 13:01:07.701694 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.701678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.702325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.702306 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 13:01:07.702427 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.702344 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.702597 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.702581 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.702693 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.702677 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hw27b\"" Jun 05 13:01:07.703200 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.703181 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.703817 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.703798 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.703915 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.703842 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vr8lw\"" Jun 05 13:01:07.703915 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.703885 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.704752 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.704732 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:07.704870 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.704848 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:07.705159 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.705143 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 13:01:07.705240 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.705220 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 13:01:07.705304 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.705264 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 13:01:07.705391 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.705370 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:01:07.705614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.705590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6gkj\"" Jun 05 13:01:07.706266 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.706355 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.706283 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:07.706355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-kubelet\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.706355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-hostroot\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.706514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-daemon-config\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.706514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aec03db-854c-4fe2-b2ba-c1ff496dca6f-konnectivity-ca\") pod \"konnectivity-agent-82n4t\" (UID: \"7aec03db-854c-4fe2-b2ba-c1ff496dca6f\") " pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.706514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-conf-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.706514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-system-cni-dir\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-system-cni-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9pd8\" (UniqueName: \"kubernetes.io/projected/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-kube-api-access-t9pd8\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmtdb\" (UniqueName: \"kubernetes.io/projected/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-kube-api-access-tmtdb\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovnkube-config\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-cni-bin\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.706711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-env-overrides\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovnkube-script-lib\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aec03db-854c-4fe2-b2ba-c1ff496dca6f-agent-certs\") pod \"konnectivity-agent-82n4t\" (UID: \"7aec03db-854c-4fe2-b2ba-c1ff496dca6f\") " pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-systemd-units\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.706984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovn-node-metrics-cert\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-socket-dir-parent\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-systemd\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-etc-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-netns\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-cni-multus\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-os-release\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-log-socket\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-os-release\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707324 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90e23822-5cf2-4525-b901-6d8b2c86300d-cni-binary-copy\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-k8s-cni-cncf-io\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707520 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-multus-certs\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707542 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-node-log\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.707588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zmm\" (UniqueName: \"kubernetes.io/projected/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-kube-api-access-59zmm\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-slash\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-host\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh82f\" (UniqueName: \"kubernetes.io/projected/90e23822-5cf2-4525-b901-6d8b2c86300d-kube-api-access-qh82f\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-serviceca\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-cni-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-etc-kubernetes\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707834 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-kubelet\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-run-netns\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-tmp-dir\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-var-lib-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-cni-bin\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-ovn\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.707979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-cni-netd\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.708005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vv5\" (UniqueName: \"kubernetes.io/projected/ffaa2e3d-bccb-4110-b2f7-063438a173b1-kube-api-access-d4vv5\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.708029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-hosts-file\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.708124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.708063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cnibin\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.708906 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.708084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:07.708906 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.708119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-cnibin\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.726321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.726304 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jgvzv" Jun 05 13:01:07.734548 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.734531 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jgvzv" Jun 05 13:01:07.797444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.797416 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 13:01:07.808495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-socket-dir-parent\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-systemd\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.808640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-etc-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.808640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-kubernetes\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.808640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-socket-dir-parent\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-systemd\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.808640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-etc-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808660 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e392fa5-9946-46f7-981d-867021791d0e-dbus\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-netns\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-systemd\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-cni-multus\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-os-release\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-netns\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-log-socket\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-cni-multus\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-sys-fs\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-os-release\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-log-socket\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-sys\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-var-lib-kubelet\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk9ks\" (UniqueName: \"kubernetes.io/projected/831af32a-8d08-45d3-a22f-10be956b2058-kube-api-access-dk9ks\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-os-release\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.808971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.808951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90e23822-5cf2-4525-b901-6d8b2c86300d-cni-binary-copy\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-os-release\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-registration-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-device-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-k8s-cni-cncf-io\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-multus-certs\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-node-log\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/322ac8b6-d039-44b5-a0c7-8e8d0e789392-tmp\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zmm\" (UniqueName: \"kubernetes.io/projected/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-kube-api-access-59zmm\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809255 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-slash\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809247 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-multus-certs\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-host-slash\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809303 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-node-log\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9f7h\" (UniqueName: \"kubernetes.io/projected/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-kube-api-access-q9f7h\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-run-k8s-cni-cncf-io\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.809720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysconfig\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-host\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-run\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e392fa5-9946-46f7-981d-867021791d0e-kubelet-config\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809432 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-host\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh82f\" (UniqueName: \"kubernetes.io/projected/90e23822-5cf2-4525-b901-6d8b2c86300d-kube-api-access-qh82f\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-slash\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90e23822-5cf2-4525-b901-6d8b2c86300d-cni-binary-copy\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-serviceca\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809609 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-cni-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-etc-kubernetes\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809710 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-cni-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-kubelet\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-etc-kubernetes\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-run-netns\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809784 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-tmp-dir\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.810561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809787 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-kubelet\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-var-lib-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-cni-bin\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-run-netns\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-ovn\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-cni-bin\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-cni-netd\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-serviceca\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-ovn\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809896 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-var-lib-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vv5\" (UniqueName: \"kubernetes.io/projected/ffaa2e3d-bccb-4110-b2f7-063438a173b1-kube-api-access-d4vv5\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-modprobe-d\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.809981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz844\" (UniqueName: \"kubernetes.io/projected/322ac8b6-d039-44b5-a0c7-8e8d0e789392-kube-api-access-rz844\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-cni-netd\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-hosts-file\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810064 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cnibin\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.811222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-host\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-hosts-file\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cnibin\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810168 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-tmp-dir\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-cnibin\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-kubelet\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-hostroot\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-daemon-config\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-cnibin\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-kubelet\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-lib-modules\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-hostroot\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aec03db-854c-4fe2-b2ba-c1ff496dca6f-konnectivity-ca\") pod \"konnectivity-agent-82n4t\" (UID: \"7aec03db-854c-4fe2-b2ba-c1ff496dca6f\") " pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-conf-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810418 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-conf-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.811960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-system-cni-dir\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810500 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-system-cni-dir\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-iptables-alerter-script\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-system-cni-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9pd8\" (UniqueName: \"kubernetes.io/projected/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-kube-api-access-t9pd8\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810671 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmtdb\" (UniqueName: \"kubernetes.io/projected/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-kube-api-access-tmtdb\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovnkube-config\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-tuned\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-cni-bin\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90e23822-5cf2-4525-b901-6d8b2c86300d-multus-daemon-config\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810798 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-env-overrides\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovnkube-script-lib\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.812793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysctl-conf\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aec03db-854c-4fe2-b2ba-c1ff496dca6f-agent-certs\") pod \"konnectivity-agent-82n4t\" (UID: \"7aec03db-854c-4fe2-b2ba-c1ff496dca6f\") " pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810932 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-run-openvswitch\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aec03db-854c-4fe2-b2ba-c1ff496dca6f-konnectivity-ca\") pod \"konnectivity-agent-82n4t\" (UID: \"7aec03db-854c-4fe2-b2ba-c1ff496dca6f\") " pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-systemd-units\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-system-cni-dir\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovn-node-metrics-cert\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811017 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90e23822-5cf2-4525-b901-6d8b2c86300d-host-var-lib-cni-bin\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysctl-d\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-socket-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mbf\" (UniqueName: \"kubernetes.io/projected/e1e6c369-861a-48d7-89d8-5032eed561f8-kube-api-access-q4mbf\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.810986 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-systemd-units\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811315 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovnkube-config\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffaa2e3d-bccb-4110-b2f7-063438a173b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.813553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.814347 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811553 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 13:01:07.814347 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811586 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-env-overrides\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.814347 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.811809 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovnkube-script-lib\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.815048 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.815022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffaa2e3d-bccb-4110-b2f7-063438a173b1-ovn-node-metrics-cert\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.815266 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.815238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aec03db-854c-4fe2-b2ba-c1ff496dca6f-agent-certs\") pod \"konnectivity-agent-82n4t\" (UID: \"7aec03db-854c-4fe2-b2ba-c1ff496dca6f\") " pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:07.815505 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.815479 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:07.815505 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.815503 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:07.815702 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.815516 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:07.815702 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.815617 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:08.315568013 +0000 UTC m=+3.007080969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:07.817254 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.817229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zmm\" (UniqueName: \"kubernetes.io/projected/6e3c4644-1a1f-4949-b7a7-0e35e29b7b33-kube-api-access-59zmm\") pod \"multus-additional-cni-plugins-8p2mk\" (UID: \"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33\") " pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:07.817400 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.817386 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh82f\" (UniqueName: \"kubernetes.io/projected/90e23822-5cf2-4525-b901-6d8b2c86300d-kube-api-access-qh82f\") pod \"multus-pknj9\" (UID: \"90e23822-5cf2-4525-b901-6d8b2c86300d\") " pod="openshift-multus/multus-pknj9" Jun 05 13:01:07.818487 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.818471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vv5\" (UniqueName: \"kubernetes.io/projected/ffaa2e3d-bccb-4110-b2f7-063438a173b1-kube-api-access-d4vv5\") pod \"ovnkube-node-g5l2w\" (UID: \"ffaa2e3d-bccb-4110-b2f7-063438a173b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:07.818716 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.818699 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmtdb\" (UniqueName: \"kubernetes.io/projected/c8c417c3-66f0-49cd-a8f5-e8a4eb00d657-kube-api-access-tmtdb\") pod \"node-resolver-l6mbd\" (UID: \"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657\") " pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:07.818898 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.818852 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9pd8\" (UniqueName: \"kubernetes.io/projected/19bdefc7-f77d-4dcc-ba01-f2cdddf63112-kube-api-access-t9pd8\") pod \"node-ca-nr54c\" (UID: \"19bdefc7-f77d-4dcc-ba01-f2cdddf63112\") " pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:07.911426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-sys-fs\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.911426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-sys\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911440 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-var-lib-kubelet\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911522 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-sys-fs\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk9ks\" (UniqueName: \"kubernetes.io/projected/831af32a-8d08-45d3-a22f-10be956b2058-kube-api-access-dk9ks\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911576 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-var-lib-kubelet\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-registration-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-device-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-sys\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.911660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/322ac8b6-d039-44b5-a0c7-8e8d0e789392-tmp\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-registration-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-host-slash\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-device-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9f7h\" (UniqueName: \"kubernetes.io/projected/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-kube-api-access-q9f7h\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911760 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-host-slash\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysconfig\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-run\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e392fa5-9946-46f7-981d-867021791d0e-kubelet-config\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.911836 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-modprobe-d\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.911900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:08.411879771 +0000 UTC m=+3.103392726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz844\" (UniqueName: \"kubernetes.io/projected/322ac8b6-d039-44b5-a0c7-8e8d0e789392-kube-api-access-rz844\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-run\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-host\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.912011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911897 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysconfig\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.911980 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-modprobe-d\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e392fa5-9946-46f7-981d-867021791d0e-kubelet-config\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.912134 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-host\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-lib-modules\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:07.912248 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:08.412223859 +0000 UTC m=+3.103736828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-iptables-alerter-script\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-tuned\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-lib-modules\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysctl-conf\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912415 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysctl-d\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-socket-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mbf\" (UniqueName: \"kubernetes.io/projected/e1e6c369-861a-48d7-89d8-5032eed561f8-kube-api-access-q4mbf\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913136 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912516 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-kubernetes\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912539 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-systemd\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912560 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysctl-conf\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e392fa5-9946-46f7-981d-867021791d0e-dbus\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912581 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-sysctl-d\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e392fa5-9946-46f7-981d-867021791d0e-dbus\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-systemd\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912710 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1e6c369-861a-48d7-89d8-5032eed561f8-socket-dir\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-kubernetes\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.913743 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.912833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-iptables-alerter-script\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.914405 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.914386 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/322ac8b6-d039-44b5-a0c7-8e8d0e789392-tmp\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.914607 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.914588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/322ac8b6-d039-44b5-a0c7-8e8d0e789392-etc-tuned\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.921998 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.921975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mbf\" (UniqueName: \"kubernetes.io/projected/e1e6c369-861a-48d7-89d8-5032eed561f8-kube-api-access-q4mbf\") pod \"aws-ebs-csi-driver-node-l4dkt\" (UID: \"e1e6c369-861a-48d7-89d8-5032eed561f8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:07.923432 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.923413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz844\" (UniqueName: \"kubernetes.io/projected/322ac8b6-d039-44b5-a0c7-8e8d0e789392-kube-api-access-rz844\") pod \"tuned-9m5c4\" (UID: \"322ac8b6-d039-44b5-a0c7-8e8d0e789392\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:07.926521 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.926498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk9ks\" (UniqueName: \"kubernetes.io/projected/831af32a-8d08-45d3-a22f-10be956b2058-kube-api-access-dk9ks\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:07.928299 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.928279 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9f7h\" (UniqueName: \"kubernetes.io/projected/9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362-kube-api-access-q9f7h\") pod \"iptables-alerter-64g9n\" (UID: \"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362\") " pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:07.954717 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:07.954656 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:08.000241 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.000207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nr54c" Jun 05 13:01:08.003778 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.003473 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:08.009359 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.009342 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6mbd" Jun 05 13:01:08.017353 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.017333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" Jun 05 13:01:08.022363 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.022344 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:08.028141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.028120 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:08.036013 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.035994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pknj9" Jun 05 13:01:08.042655 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.042639 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64g9n" Jun 05 13:01:08.048772 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.048752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" Jun 05 13:01:08.053811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.053793 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" Jun 05 13:01:08.415675 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.415595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:08.415838 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.415675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:08.415838 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.415714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:08.415838 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415753 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:08.415838 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415821 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:09.415800712 +0000 UTC m=+4.107313664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:08.415999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415839 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:08.415999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415866 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:08.415999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415888 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:08.415999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415902 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:08.415999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415902 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:09.415884919 +0000 UTC m=+4.107397885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:08.415999 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:08.415960 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:09.415945737 +0000 UTC m=+4.107458690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:08.512383 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.512349 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e23822_5cf2_4525_b901_6d8b2c86300d.slice/crio-495326555cf78b40b440a0acd534c97e0da305fad13b59baf864a5b90d9cd959 WatchSource:0}: Error finding container 495326555cf78b40b440a0acd534c97e0da305fad13b59baf864a5b90d9cd959: Status 404 returned error can't find the container with id 495326555cf78b40b440a0acd534c97e0da305fad13b59baf864a5b90d9cd959 Jun 05 13:01:08.517440 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.517419 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3c4644_1a1f_4949_b7a7_0e35e29b7b33.slice/crio-a1aaee77fa3c44051442b1b4eede3621b7a5aed07a866d851abedefff7d82b54 WatchSource:0}: Error finding container a1aaee77fa3c44051442b1b4eede3621b7a5aed07a866d851abedefff7d82b54: Status 404 returned error can't find the container with id a1aaee77fa3c44051442b1b4eede3621b7a5aed07a866d851abedefff7d82b54 Jun 05 13:01:08.518291 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.518268 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffaa2e3d_bccb_4110_b2f7_063438a173b1.slice/crio-7d6d700ab0d77e9ab824aeaf0b900f2caea24a7d9a8cbe816b0284457933f820 WatchSource:0}: Error finding container 7d6d700ab0d77e9ab824aeaf0b900f2caea24a7d9a8cbe816b0284457933f820: Status 404 returned error can't find the container with id 7d6d700ab0d77e9ab824aeaf0b900f2caea24a7d9a8cbe816b0284457933f820 Jun 05 13:01:08.519500 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.519481 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bdefc7_f77d_4dcc_ba01_f2cdddf63112.slice/crio-15101a4e121a6718b482521300af9d1516b798681739bf5ad2afcff216110d27 WatchSource:0}: Error finding container 15101a4e121a6718b482521300af9d1516b798681739bf5ad2afcff216110d27: Status 404 returned error can't find the container with id 15101a4e121a6718b482521300af9d1516b798681739bf5ad2afcff216110d27 Jun 05 13:01:08.520717 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.520375 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e6c369_861a_48d7_89d8_5032eed561f8.slice/crio-014c8511c7a0c63748b1e22fc281e7fa0a7556561db0ad589216d2d4f0220b78 WatchSource:0}: Error finding container 014c8511c7a0c63748b1e22fc281e7fa0a7556561db0ad589216d2d4f0220b78: Status 404 returned error can't find the container with id 014c8511c7a0c63748b1e22fc281e7fa0a7556561db0ad589216d2d4f0220b78 Jun 05 13:01:08.521189 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.521165 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aec03db_854c_4fe2_b2ba_c1ff496dca6f.slice/crio-497e758ade700d078fa52c1ad3f79065d4dcce6dde488fc7d36254f2735b7dbe WatchSource:0}: Error finding container 497e758ade700d078fa52c1ad3f79065d4dcce6dde488fc7d36254f2735b7dbe: Status 404 returned error can't find the container with id 497e758ade700d078fa52c1ad3f79065d4dcce6dde488fc7d36254f2735b7dbe Jun 05 13:01:08.522551 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.522520 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc63dac_fb6b_4ef3_8a52_b1e8f1c87362.slice/crio-90279238d24b02fffd3204fdd7a789f707278372b838e1dccc61c1926584fec6 WatchSource:0}: Error finding container 90279238d24b02fffd3204fdd7a789f707278372b838e1dccc61c1926584fec6: Status 404 returned error can't find the container with id 90279238d24b02fffd3204fdd7a789f707278372b838e1dccc61c1926584fec6 Jun 05 13:01:08.523182 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.522980 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322ac8b6_d039_44b5_a0c7_8e8d0e789392.slice/crio-f1c6e059e5b5c55158dafd9060572f5a50c8c5a3b5d6b0ab621ae3464d8bd727 WatchSource:0}: Error finding container f1c6e059e5b5c55158dafd9060572f5a50c8c5a3b5d6b0ab621ae3464d8bd727: Status 404 returned error can't find the container with id f1c6e059e5b5c55158dafd9060572f5a50c8c5a3b5d6b0ab621ae3464d8bd727 Jun 05 13:01:08.524184 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:08.524153 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c417c3_66f0_49cd_a8f5_e8a4eb00d657.slice/crio-d4a84b575c31bab22d9755f04ae14b4454f0ca67fa58e3ccf6ced643c6f45905 WatchSource:0}: Error finding container d4a84b575c31bab22d9755f04ae14b4454f0ca67fa58e3ccf6ced643c6f45905: Status 404 returned error can't find the container with id d4a84b575c31bab22d9755f04ae14b4454f0ca67fa58e3ccf6ced643c6f45905 Jun 05 13:01:08.737359 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.737170 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 12:56:07 +0000 UTC" deadline="2027-11-27 11:32:22.312335157 +0000 UTC" Jun 05 13:01:08.737359 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.737353 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12958h31m13.574985892s" Jun 05 13:01:08.766441 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.766407 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" event={"ID":"322ac8b6-d039-44b5-a0c7-8e8d0e789392","Type":"ContainerStarted","Data":"f1c6e059e5b5c55158dafd9060572f5a50c8c5a3b5d6b0ab621ae3464d8bd727"} Jun 05 13:01:08.767403 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.767375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64g9n" event={"ID":"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362","Type":"ContainerStarted","Data":"90279238d24b02fffd3204fdd7a789f707278372b838e1dccc61c1926584fec6"} Jun 05 13:01:08.768416 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.768399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nr54c" event={"ID":"19bdefc7-f77d-4dcc-ba01-f2cdddf63112","Type":"ContainerStarted","Data":"15101a4e121a6718b482521300af9d1516b798681739bf5ad2afcff216110d27"} Jun 05 13:01:08.769470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.769447 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"7d6d700ab0d77e9ab824aeaf0b900f2caea24a7d9a8cbe816b0284457933f820"} Jun 05 13:01:08.770442 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.770422 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" event={"ID":"e1e6c369-861a-48d7-89d8-5032eed561f8","Type":"ContainerStarted","Data":"014c8511c7a0c63748b1e22fc281e7fa0a7556561db0ad589216d2d4f0220b78"} Jun 05 13:01:08.772303 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.772285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" event={"ID":"559b7c555df026f06f2605e41632946e","Type":"ContainerStarted","Data":"7f35cb9fc2dd7088d81550148239ce0390d7256ef311e4a8518be418ae30326b"} Jun 05 13:01:08.773720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.773699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"e70e51b6f7a224f28138ba1bcd816eda","Type":"ContainerStarted","Data":"553e1e8a93c38b4e3ed4782a7eab39ddd37efbb556ba93b38737adac6b94ee27"} Jun 05 13:01:08.774683 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.774668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82n4t" event={"ID":"7aec03db-854c-4fe2-b2ba-c1ff496dca6f","Type":"ContainerStarted","Data":"497e758ade700d078fa52c1ad3f79065d4dcce6dde488fc7d36254f2735b7dbe"} Jun 05 13:01:08.775675 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.775655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerStarted","Data":"a1aaee77fa3c44051442b1b4eede3621b7a5aed07a866d851abedefff7d82b54"} Jun 05 13:01:08.776660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.776642 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pknj9" event={"ID":"90e23822-5cf2-4525-b901-6d8b2c86300d","Type":"ContainerStarted","Data":"495326555cf78b40b440a0acd534c97e0da305fad13b59baf864a5b90d9cd959"} Jun 05 13:01:08.777663 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.777647 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6mbd" event={"ID":"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657","Type":"ContainerStarted","Data":"d4a84b575c31bab22d9755f04ae14b4454f0ca67fa58e3ccf6ced643c6f45905"} Jun 05 13:01:08.785141 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.785092 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-150.ec2.internal" podStartSLOduration=1.785081131 podStartE2EDuration="1.785081131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:08.784695803 +0000 UTC m=+3.476208777" watchObservedRunningTime="2026-06-05 13:01:08.785081131 +0000 UTC m=+3.476594106" Jun 05 13:01:08.815752 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:08.815728 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:09.424450 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.424399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:09.424629 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.424472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:09.424629 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.424502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:09.424759 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.424647 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:09.424759 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.424664 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:09.424759 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.424678 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:09.424759 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.424733 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:11.42471627 +0000 UTC m=+6.116229228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:09.425201 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.425078 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:09.425201 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.425159 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:09.425201 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.425168 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:11.425148544 +0000 UTC m=+6.116661511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:09.425407 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.425206 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:11.425191882 +0000 UTC m=+6.116704839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:09.738411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.738301 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 12:56:07 +0000 UTC" deadline="2028-02-10 16:04:05.211009519 +0000 UTC" Jun 05 13:01:09.738411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.738364 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14763h2m55.47264946s" Jun 05 13:01:09.761427 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.760913 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:09.761427 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.761032 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:09.761427 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.761131 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:09.761427 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.761241 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:09.761427 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.761308 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:09.761427 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:09.761379 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:09.801904 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.801865 2558 generic.go:356] "Generic (PLEG): container finished" podID="e70e51b6f7a224f28138ba1bcd816eda" containerID="553e1e8a93c38b4e3ed4782a7eab39ddd37efbb556ba93b38737adac6b94ee27" exitCode=0 Jun 05 13:01:09.802442 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:09.802416 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"e70e51b6f7a224f28138ba1bcd816eda","Type":"ContainerDied","Data":"553e1e8a93c38b4e3ed4782a7eab39ddd37efbb556ba93b38737adac6b94ee27"} Jun 05 13:01:10.823615 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:10.823575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" event={"ID":"e70e51b6f7a224f28138ba1bcd816eda","Type":"ContainerStarted","Data":"d8e4b49bde22471343a8984449618f9020b93a4648da489f7463b9278178a73b"} Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:11.440958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:11.441025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:11.441058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441224 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441245 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441257 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441318 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:15.441297542 +0000 UTC m=+10.132810500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441735 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441786 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:15.441771483 +0000 UTC m=+10.133284439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441849 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:11.441951 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.441883 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:15.441869637 +0000 UTC m=+10.133382606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:11.759580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:11.758754 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:11.759580 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.758870 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:11.759580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:11.759272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:11.759580 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.759376 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:11.759580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:11.759426 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:11.759580 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:11.759501 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:13.758898 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:13.758863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:13.759380 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:13.758874 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:13.759380 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:13.758999 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:13.759380 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:13.759137 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:13.759380 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:13.759168 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:13.759380 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:13.759233 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:15.474640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:15.474446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:15.474640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:15.474493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:15.474640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:15.474554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474726 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474747 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474768 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474781 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474800 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:23.474778826 +0000 UTC m=+18.166291801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474833 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:23.474816878 +0000 UTC m=+18.166329831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474891 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:15.475264 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.474929 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:23.474916965 +0000 UTC m=+18.166429920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:15.759483 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:15.759403 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:15.759644 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:15.759535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:15.759644 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:15.759564 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:15.759644 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.759583 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:15.759644 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.759626 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:15.759842 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:15.759683 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:17.759127 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:17.759057 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:17.759613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:17.759063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:17.759613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:17.759057 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:17.759613 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:17.759319 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:17.759613 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:17.759387 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:17.759842 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:17.759810 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:19.758505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:19.758473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:19.758505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:19.758494 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:19.759000 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:19.758473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:19.759000 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:19.758605 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:19.759000 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:19.758680 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:19.759000 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:19.758761 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:21.758720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:21.758683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:21.758720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:21.758683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:21.759322 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:21.758798 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:21.759322 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:21.758796 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:21.759322 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:21.758916 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:21.759322 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:21.759012 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:23.535530 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:23.535490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:23.535558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:23.535584 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535649 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535694 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535705 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535720 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535727 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:39.535708831 +0000 UTC m=+34.227221786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535732 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535748 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:39.535740449 +0000 UTC m=+34.227253401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:23.535960 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.535807 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:01:39.535785359 +0000 UTC m=+34.227298323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:23.758610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:23.758580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:23.758769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:23.758593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:23.758769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:23.758706 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:23.758769 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.758703 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:23.758943 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.758845 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:23.758995 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:23.758947 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:25.759607 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:25.759570 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:25.760215 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:25.759657 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:25.760215 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:25.759676 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:25.760215 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:25.759778 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:25.760215 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:25.759829 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:25.760215 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:25.759891 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:27.759282 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.758856 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:27.759929 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:27.759399 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:27.759929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.758886 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:27.759929 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:27.759490 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:27.759929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.758854 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:27.759929 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:27.759561 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:27.859784 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.859752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6mbd" event={"ID":"c8c417c3-66f0-49cd-a8f5-e8a4eb00d657","Type":"ContainerStarted","Data":"a0be37006dfcb891a4a5eafdab04f4049284ee39922f911a12cd5d316dc76047"} Jun 05 13:01:27.861120 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.861078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" event={"ID":"322ac8b6-d039-44b5-a0c7-8e8d0e789392","Type":"ContainerStarted","Data":"fceeeaa5c28b7ca0a8be2b9750e91cd44ce98ff10fac02da38496051ce7d2888"} Jun 05 13:01:27.862460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.862436 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nr54c" event={"ID":"19bdefc7-f77d-4dcc-ba01-f2cdddf63112","Type":"ContainerStarted","Data":"ec716af03b9649189351e0d31ca56fb4a7767c055a3c5ad30df944ac9ce67883"} Jun 05 13:01:27.865344 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865325 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:01:27.865694 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865672 2558 generic.go:356] "Generic (PLEG): container finished" podID="ffaa2e3d-bccb-4110-b2f7-063438a173b1" containerID="1b611429fb9fe8bbacd9427a373f6a42da9dd73b7f1df462773c467e856d23ca" exitCode=1 Jun 05 13:01:27.865753 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"c2ca3302f0d3f2ddffa3adfd55ed40148ca35c130ca21db3e97ad289619318ab"} Jun 05 13:01:27.865807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865800 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"4835d733e284ac23bcd52fce161611e0830a72dda47bbd23bddb56445d92b21c"} Jun 05 13:01:27.865860 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"5cdb4706340e66292dee2412779a13603dbfd2afccaf4464465850f889b05784"} Jun 05 13:01:27.865911 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"6063ad86c0be32eb9de4d00c40b7329f919821879b3a148e621d8d4252b20aaa"} Jun 05 13:01:27.865911 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerDied","Data":"1b611429fb9fe8bbacd9427a373f6a42da9dd73b7f1df462773c467e856d23ca"} Jun 05 13:01:27.866006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.865955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"ea9b674e4917fb8c37fb5b9191ec32972b4382c41054a720d5afcc2c3dabbf07"} Jun 05 13:01:27.867093 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.867074 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" event={"ID":"e1e6c369-861a-48d7-89d8-5032eed561f8","Type":"ContainerStarted","Data":"5ca7e568eaeb65588b862a771ba879267b2e0f19e9186e6eb82b85e6ff462d92"} Jun 05 13:01:27.871760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.871732 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82n4t" event={"ID":"7aec03db-854c-4fe2-b2ba-c1ff496dca6f","Type":"ContainerStarted","Data":"b73c7f0f570399bd22222e13c1896fc95c03079d42739035d2cc7cf9748a9b4e"} Jun 05 13:01:27.873256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.873235 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e3c4644-1a1f-4949-b7a7-0e35e29b7b33" containerID="1bd624713e9e44c0ee72b1929aaf659eca0711e198ec843155067fd0601dfe8c" exitCode=0 Jun 05 13:01:27.873434 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.873382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerDied","Data":"1bd624713e9e44c0ee72b1929aaf659eca0711e198ec843155067fd0601dfe8c"} Jun 05 13:01:27.873705 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.873660 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-150.ec2.internal" podStartSLOduration=20.87364304 podStartE2EDuration="20.87364304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:10.839351566 +0000 UTC m=+5.530864544" watchObservedRunningTime="2026-06-05 13:01:27.87364304 +0000 UTC m=+22.565156024" Jun 05 13:01:27.874263 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.874154 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l6mbd" podStartSLOduration=4.340969734 podStartE2EDuration="22.874146608s" totalImagesPullingTime="18.533176874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:27.87328001 +0000 UTC m=+22.564792986" watchObservedRunningTime="2026-06-05 13:01:27.874146608 +0000 UTC m=+22.565659583" Jun 05 13:01:27.874915 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.874863 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pknj9" event={"ID":"90e23822-5cf2-4525-b901-6d8b2c86300d","Type":"ContainerStarted","Data":"c35600da54033fc0bbb0fb0e58324619a2d900ab0955f7dd3026130371a0be5b"} Jun 05 13:01:27.891935 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.891899 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9m5c4" podStartSLOduration=4.354535542 podStartE2EDuration="22.891886195s" totalImagesPullingTime="18.537350653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:27.891487687 +0000 UTC m=+22.583000664" watchObservedRunningTime="2026-06-05 13:01:27.891886195 +0000 UTC m=+22.583399171" Jun 05 13:01:27.905747 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.905641 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nr54c" podStartSLOduration=4.367530226 podStartE2EDuration="22.905625637s" totalImagesPullingTime="18.538095411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:27.905022747 +0000 UTC m=+22.596535724" watchObservedRunningTime="2026-06-05 13:01:27.905625637 +0000 UTC m=+22.597138617" Jun 05 13:01:27.923025 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.922982 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-82n4t" podStartSLOduration=8.499327726 podStartE2EDuration="22.92296717s" totalImagesPullingTime="14.423639444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:27.922846632 +0000 UTC m=+22.614359609" watchObservedRunningTime="2026-06-05 13:01:27.92296717 +0000 UTC m=+22.614480146" Jun 05 13:01:27.976394 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:27.976337 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pknj9" podStartSLOduration=4.39336183 podStartE2EDuration="22.976316343s" totalImagesPullingTime="18.582954513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:27.976310062 +0000 UTC m=+22.667823036" watchObservedRunningTime="2026-06-05 13:01:27.976316343 +0000 UTC m=+22.667829319" Jun 05 13:01:28.506579 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.506540 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 13:01:28.761985 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.761785 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T13:01:28.506560886Z","UUID":"d0004009-a309-4e53-bb35-fef9a94ddd03","Handler":null,"Name":"","Endpoint":""} Jun 05 13:01:28.763432 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.763409 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 13:01:28.763432 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.763446 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 13:01:28.879036 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.878971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64g9n" event={"ID":"9bc63dac-fb6b-4ef3-8a52-b1e8f1c87362","Type":"ContainerStarted","Data":"91e373ce180894c5cabcc54265300ab2caab9610cf8cc50264ac8ab355b13a2d"} Jun 05 13:01:28.880996 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.880950 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" event={"ID":"e1e6c369-861a-48d7-89d8-5032eed561f8","Type":"ContainerStarted","Data":"d9e0832f4ae3de5f8188afcbb313e6b4a2d396512c65938c3f14b4b73aef32b8"} Jun 05 13:01:28.893958 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.893900 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-64g9n" podStartSLOduration=5.358602449 podStartE2EDuration="23.893880424s" totalImagesPullingTime="18.535277975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:28.892957155 +0000 UTC m=+23.584470130" watchObservedRunningTime="2026-06-05 13:01:28.893880424 +0000 UTC m=+23.585393401" Jun 05 13:01:28.994692 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.994659 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:28.995315 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:28.995292 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:29.759471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.759382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:29.759471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.759392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:29.759709 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:29.759517 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:29.759709 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.759400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:29.759709 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:29.759603 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:29.759709 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:29.759666 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:29.885540 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.885501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" event={"ID":"e1e6c369-861a-48d7-89d8-5032eed561f8","Type":"ContainerStarted","Data":"e877d93066c06864163a47d59ca7150eaadee8d89284425d283021e64a3a3b4d"} Jun 05 13:01:29.886014 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.885984 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:29.886346 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.886325 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-82n4t" Jun 05 13:01:29.904295 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:29.904245 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4dkt" podStartSLOduration=4.296871383 podStartE2EDuration="24.904230948s" totalImagesPullingTime="20.607359565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:29.903886757 +0000 UTC m=+24.595399734" watchObservedRunningTime="2026-06-05 13:01:29.904230948 +0000 UTC m=+24.595743922" Jun 05 13:01:30.890593 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:30.890414 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:01:30.891065 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:30.890987 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"c4ea046fcd3bf9ebb532fa7e84c35b8acd9f268ad879dd91bc6ac1b9a5ac49dc"} Jun 05 13:01:31.758814 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:31.758719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:31.759113 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:31.758728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:31.759113 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:31.758856 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:31.759113 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:31.758873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:31.759113 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:31.758975 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:31.759113 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:31.759050 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:32.897273 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.897072 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e3c4644-1a1f-4949-b7a7-0e35e29b7b33" containerID="ff8a4b0b55c6c471e75693c4a0c7bd67571b99dad3d62a6a10e401f60f23c506" exitCode=0 Jun 05 13:01:32.898003 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.897137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerDied","Data":"ff8a4b0b55c6c471e75693c4a0c7bd67571b99dad3d62a6a10e401f60f23c506"} Jun 05 13:01:32.900826 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.900808 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:01:32.901176 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.901152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"98f36a5110d5d7467e7d163c766b5343af7e0b4e1aec4b6af2eb8bbeee1adf88"} Jun 05 13:01:32.901426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.901403 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:32.901514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.901475 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:32.901585 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.901524 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:32.901585 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.901534 2558 scope.go:117] "RemoveContainer" containerID="1b611429fb9fe8bbacd9427a373f6a42da9dd73b7f1df462773c467e856d23ca" Jun 05 13:01:32.919870 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.919848 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:32.919973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:32.919961 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:01:33.758408 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.758331 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:33.758558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.758333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:33.758558 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:33.758464 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:33.758558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.758483 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:33.758706 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:33.758598 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:33.758706 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:33.758688 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:33.906713 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.906687 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:01:33.907144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.907093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" event={"ID":"ffaa2e3d-bccb-4110-b2f7-063438a173b1","Type":"ContainerStarted","Data":"b9b2495e1693f83c164593a030e9d5bbe9e4ac88141a9311db46e1be87e28424"} Jun 05 13:01:33.909132 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.909094 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e3c4644-1a1f-4949-b7a7-0e35e29b7b33" containerID="f2d49682d1dc22575d78f94df5110e6350f288dda002009686c8976da200c3dd" exitCode=0 Jun 05 13:01:33.909258 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.909142 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerDied","Data":"f2d49682d1dc22575d78f94df5110e6350f288dda002009686c8976da200c3dd"} Jun 05 13:01:33.936958 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.936915 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" podStartSLOduration=10.380276509 podStartE2EDuration="28.936902377s" totalImagesPullingTime="18.556625868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:33.936584221 +0000 UTC m=+28.628097195" watchObservedRunningTime="2026-06-05 13:01:33.936902377 +0000 UTC m=+28.628415351" Jun 05 13:01:33.994117 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.994073 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-92c4b"] Jun 05 13:01:33.994275 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.994222 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:33.994333 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:33.994314 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:33.997440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.997382 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-55hcn"] Jun 05 13:01:33.997593 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.997578 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:33.997693 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:33.997677 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:33.997963 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.997935 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnlk6"] Jun 05 13:01:33.998062 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:33.998042 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:33.998172 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:33.998149 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:34.913799 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:34.913627 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e3c4644-1a1f-4949-b7a7-0e35e29b7b33" containerID="1451e34c72046f9767a53fa22f0c3d07652fdb5c0ea8b841c22f4ee685f69f1b" exitCode=0 Jun 05 13:01:34.914286 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:34.913710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerDied","Data":"1451e34c72046f9767a53fa22f0c3d07652fdb5c0ea8b841c22f4ee685f69f1b"} Jun 05 13:01:35.759515 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:35.759483 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:35.759678 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:35.759563 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:35.759678 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:35.759596 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:35.759678 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:35.759636 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:35.759678 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:35.759670 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:35.759876 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:35.759834 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:37.758758 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:37.758724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:37.758758 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:37.758730 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:37.759559 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:37.758724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:37.759559 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:37.758862 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:37.759559 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:37.758949 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:37.759559 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:37.759029 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:39.554235 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.554150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:39.554235 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.554193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:39.554235 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.554217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554295 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554305 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554328 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554343 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554354 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cjqc5 for pod openshift-network-diagnostics/network-check-target-55hcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554356 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret podName:2e392fa5-9946-46f7-981d-867021791d0e nodeName:}" failed. No retries permitted until 2026-06-05 13:02:11.554341384 +0000 UTC m=+66.245854336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret") pod "global-pull-secret-syncer-92c4b" (UID: "2e392fa5-9946-46f7-981d-867021791d0e") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554378 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:11.554366464 +0000 UTC m=+66.245879417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:39.554647 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.554389 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5 podName:6f50b796-e674-4a8e-acb6-22736afbf68e nodeName:}" failed. No retries permitted until 2026-06-05 13:02:11.554383252 +0000 UTC m=+66.245896204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjqc5" (UniqueName: "kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5") pod "network-check-target-55hcn" (UID: "6f50b796-e674-4a8e-acb6-22736afbf68e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:39.732989 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.732956 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:39.761177 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.761152 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:39.761177 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.761166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:39.761350 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.761166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:39.761350 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.761239 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92c4b" podUID="2e392fa5-9946-46f7-981d-867021791d0e" Jun 05 13:01:39.761416 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.761352 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:01:39.761459 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:39.761420 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55hcn" podUID="6f50b796-e674-4a8e-acb6-22736afbf68e" Jun 05 13:01:39.819411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.819341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:39.918933 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.918892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:39.926762 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.926733 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e3c4644-1a1f-4949-b7a7-0e35e29b7b33" containerID="e04a8b0b8df8ba9fc08f6ff2940d0f0fbbad489904b46feae8f7c5a9151b4a74" exitCode=0 Jun 05 13:01:39.926882 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.926794 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerDied","Data":"e04a8b0b8df8ba9fc08f6ff2940d0f0fbbad489904b46feae8f7c5a9151b4a74"} Jun 05 13:01:39.976610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:39.976529 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:40.131513 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.131490 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-150.ec2.internal" event="NodeReady" Jun 05 13:01:40.131629 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.131612 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 13:01:40.179229 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.179200 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9qxkm"] Jun 05 13:01:40.190714 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.190693 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-clnk2"] Jun 05 13:01:40.190843 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.190827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.193356 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.193338 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 13:01:40.193661 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.193637 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 13:01:40.193749 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.193690 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ncksb\"" Jun 05 13:01:40.202863 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.202845 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9qxkm"] Jun 05 13:01:40.202953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.202877 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clnk2"] Jun 05 13:01:40.202953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.202940 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.205225 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.205205 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 13:01:40.205225 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.205224 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 13:01:40.205398 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.205244 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 13:01:40.205398 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.205305 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rrg9b\"" Jun 05 13:01:40.262760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.262731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.262911 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.262771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a00ab16-fe20-4cdf-8de9-c7405990f067-tmp-dir\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.262911 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.262800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a00ab16-fe20-4cdf-8de9-c7405990f067-config-volume\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.262911 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.262824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvxf\" (UniqueName: \"kubernetes.io/projected/6a00ab16-fe20-4cdf-8de9-c7405990f067-kube-api-access-dcvxf\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.288435 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.288408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:40.363678 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.363606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.363678 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.363650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntgw\" (UniqueName: \"kubernetes.io/projected/bdd3098c-6ec6-4068-8990-590cb87e218d-kube-api-access-5ntgw\") pod \"ingress-canary-clnk2\" (UID: \"bdd3098c-6ec6-4068-8990-590cb87e218d\") " pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.363847 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:40.363771 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:40.363847 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.363771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a00ab16-fe20-4cdf-8de9-c7405990f067-tmp-dir\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.363847 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:40.363840 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:40.863817898 +0000 UTC m=+35.555330866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:01:40.364006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.363901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdd3098c-6ec6-4068-8990-590cb87e218d-cert\") pod \"ingress-canary-clnk2\" (UID: \"bdd3098c-6ec6-4068-8990-590cb87e218d\") " pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.364006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.363934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a00ab16-fe20-4cdf-8de9-c7405990f067-config-volume\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.364006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.363959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvxf\" (UniqueName: \"kubernetes.io/projected/6a00ab16-fe20-4cdf-8de9-c7405990f067-kube-api-access-dcvxf\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.364183 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.364018 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a00ab16-fe20-4cdf-8de9-c7405990f067-tmp-dir\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.364481 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.364462 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a00ab16-fe20-4cdf-8de9-c7405990f067-config-volume\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.373555 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.373533 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvxf\" (UniqueName: \"kubernetes.io/projected/6a00ab16-fe20-4cdf-8de9-c7405990f067-kube-api-access-dcvxf\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.388459 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.388435 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:40.464557 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.464525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdd3098c-6ec6-4068-8990-590cb87e218d-cert\") pod \"ingress-canary-clnk2\" (UID: \"bdd3098c-6ec6-4068-8990-590cb87e218d\") " pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.464721 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.464632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntgw\" (UniqueName: \"kubernetes.io/projected/bdd3098c-6ec6-4068-8990-590cb87e218d-kube-api-access-5ntgw\") pod \"ingress-canary-clnk2\" (UID: \"bdd3098c-6ec6-4068-8990-590cb87e218d\") " pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.466920 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.466900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdd3098c-6ec6-4068-8990-590cb87e218d-cert\") pod \"ingress-canary-clnk2\" (UID: \"bdd3098c-6ec6-4068-8990-590cb87e218d\") " pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.475294 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.475140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntgw\" (UniqueName: \"kubernetes.io/projected/bdd3098c-6ec6-4068-8990-590cb87e218d-kube-api-access-5ntgw\") pod \"ingress-canary-clnk2\" (UID: \"bdd3098c-6ec6-4068-8990-590cb87e218d\") " pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.488765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.488739 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:40.510744 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.510724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clnk2" Jun 05 13:01:40.677797 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.677770 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clnk2"] Jun 05 13:01:40.681903 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:40.681877 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd3098c_6ec6_4068_8990_590cb87e218d.slice/crio-e0442e6bd05dd67130f99dfcb3884ee784ec2f0db86ee7ebf023146a80960000 WatchSource:0}: Error finding container e0442e6bd05dd67130f99dfcb3884ee784ec2f0db86ee7ebf023146a80960000: Status 404 returned error can't find the container with id e0442e6bd05dd67130f99dfcb3884ee784ec2f0db86ee7ebf023146a80960000 Jun 05 13:01:40.868422 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.868390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:40.868645 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:40.868551 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:40.868645 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:40.868632 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:41.868611656 +0000 UTC m=+36.560124613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:01:40.931731 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.931649 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e3c4644-1a1f-4949-b7a7-0e35e29b7b33" containerID="2a4576bad3ba0512d2cd54c01b8a9a9285a34ec07d7d061a35d2fc18f94136a8" exitCode=0 Jun 05 13:01:40.931878 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.931728 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerDied","Data":"2a4576bad3ba0512d2cd54c01b8a9a9285a34ec07d7d061a35d2fc18f94136a8"} Jun 05 13:01:40.932820 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:40.932795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clnk2" event={"ID":"bdd3098c-6ec6-4068-8990-590cb87e218d","Type":"ContainerStarted","Data":"e0442e6bd05dd67130f99dfcb3884ee784ec2f0db86ee7ebf023146a80960000"} Jun 05 13:01:41.758545 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.758506 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:01:41.759167 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.758506 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:01:41.759167 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.758636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:01:41.762182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.762034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:01:41.762182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.762045 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:01:41.762182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.762040 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqt82\"" Jun 05 13:01:41.762182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.762045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:01:41.762182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.762117 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v8nr\"" Jun 05 13:01:41.762182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.762058 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:01:41.875498 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.875454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:41.875674 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:41.875583 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:41.875674 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:41.875639 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:43.875624301 +0000 UTC m=+38.567137254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:01:41.939348 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.939077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" event={"ID":"6e3c4644-1a1f-4949-b7a7-0e35e29b7b33","Type":"ContainerStarted","Data":"b8ae2818185623384b0c78cd6441790a201e336ab62dab9ff4cfa3599cbbd6d5"} Jun 05 13:01:41.960421 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:41.960379 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8p2mk" podStartSLOduration=9.087607088 podStartE2EDuration="36.960362887s" totalImagesPullingTime="27.872755799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:41.958725342 +0000 UTC m=+36.650238317" watchObservedRunningTime="2026-06-05 13:01:41.960362887 +0000 UTC m=+36.651875862" Jun 05 13:01:42.079877 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:42.079797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:42.179733 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:42.179695 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:42.709955 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:42.709913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:42.808491 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:42.808460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:42.943207 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:42.943171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clnk2" event={"ID":"bdd3098c-6ec6-4068-8990-590cb87e218d","Type":"ContainerStarted","Data":"97a4acf903095a3fd96714d34aa4545a3946bb450d27664e36c0bc63ce6a8695"} Jun 05 13:01:42.960367 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:42.960282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-clnk2" podStartSLOduration=0.922671312 podStartE2EDuration="2.960267284s" totalImagesPullingTime="2.037595972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:42.959345258 +0000 UTC m=+37.650858235" watchObservedRunningTime="2026-06-05 13:01:42.960267284 +0000 UTC m=+37.651780258" Jun 05 13:01:43.888920 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:43.888835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:43.889379 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:43.888960 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:43.889379 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:43.889012 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:47.888999532 +0000 UTC m=+42.580512484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:01:45.344115 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:45.344054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:45.396127 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:45.396079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:01:47.916374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:47.916330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:47.916744 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:47.916460 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:47.916744 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:47.916514 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:55.916500093 +0000 UTC m=+50.608013046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:01:55.975556 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:55.975521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:01:55.976017 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:55.975630 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:55.976017 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:01:55.975687 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:11.975672709 +0000 UTC m=+66.667185661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:01:56.298271 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.298198 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9"] Jun 05 13:01:56.310514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.310489 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.312294 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.312271 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9"] Jun 05 13:01:56.313799 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.313769 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 13:01:56.313893 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.313774 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 13:01:56.313965 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.313774 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 13:01:56.313965 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.313773 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 13:01:56.479281 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.479246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58c87b6c-38c9-4b38-bb27-76ae588c01c6-klusterlet-config\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.479281 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.479290 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qpp\" (UniqueName: \"kubernetes.io/projected/58c87b6c-38c9-4b38-bb27-76ae588c01c6-kube-api-access-68qpp\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.479481 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.479330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58c87b6c-38c9-4b38-bb27-76ae588c01c6-tmp\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.580686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.580599 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58c87b6c-38c9-4b38-bb27-76ae588c01c6-tmp\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.580686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.580667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58c87b6c-38c9-4b38-bb27-76ae588c01c6-klusterlet-config\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.580909 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.580710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qpp\" (UniqueName: \"kubernetes.io/projected/58c87b6c-38c9-4b38-bb27-76ae588c01c6-kube-api-access-68qpp\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.580987 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.580965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58c87b6c-38c9-4b38-bb27-76ae588c01c6-tmp\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.584687 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.584668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58c87b6c-38c9-4b38-bb27-76ae588c01c6-klusterlet-config\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.587927 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.587906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qpp\" (UniqueName: \"kubernetes.io/projected/58c87b6c-38c9-4b38-bb27-76ae588c01c6-kube-api-access-68qpp\") pod \"klusterlet-addon-workmgr-f99b7cc99-qhbr9\" (UID: \"58c87b6c-38c9-4b38-bb27-76ae588c01c6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.620711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.620672 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:01:56.779223 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.779179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9"] Jun 05 13:01:56.782850 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:01:56.782820 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c87b6c_38c9_4b38_bb27_76ae588c01c6.slice/crio-736225ffbffe9db91a287cfcf3df1efe409dfcca148d38d0feb8d8d42937f40a WatchSource:0}: Error finding container 736225ffbffe9db91a287cfcf3df1efe409dfcca148d38d0feb8d8d42937f40a: Status 404 returned error can't find the container with id 736225ffbffe9db91a287cfcf3df1efe409dfcca148d38d0feb8d8d42937f40a Jun 05 13:01:56.974366 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:01:56.974335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" event={"ID":"58c87b6c-38c9-4b38-bb27-76ae588c01c6","Type":"ContainerStarted","Data":"736225ffbffe9db91a287cfcf3df1efe409dfcca148d38d0feb8d8d42937f40a"} Jun 05 13:02:00.989094 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:00.989063 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" event={"ID":"58c87b6c-38c9-4b38-bb27-76ae588c01c6","Type":"ContainerStarted","Data":"f29c999a4a7d7565b0b517bb128691a437383784ce56f4528d31aff3320c4b9a"} Jun 05 13:02:00.989497 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:00.989304 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:02:00.990694 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:00.990675 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:02:01.005150 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:01.005092 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" podStartSLOduration=0.996466007 podStartE2EDuration="5.005079423s" totalImagesPullingTime="4.008613416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:01.004167983 +0000 UTC m=+55.695680958" watchObservedRunningTime="2026-06-05 13:02:01.005079423 +0000 UTC m=+55.696592398" Jun 05 13:02:01.254593 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:01.254551 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:01.321718 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:01.321686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:01.698368 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:01.698269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:01.798547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:01.798515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:04.924195 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:04.924168 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5l2w" Jun 05 13:02:05.032151 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:05.032087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:05.087278 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:05.087240 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:05.136226 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:05.136178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:11.593960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.593916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:02:11.594465 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.593984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:02:11.594465 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.594011 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:02:11.596414 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.596391 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:02:11.596566 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.596545 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:02:11.596669 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.596651 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:02:11.604460 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:02:11.604446 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:02:11.604531 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:02:11.604501 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:03:15.604485453 +0000 UTC m=+130.295998406 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : secret "metrics-daemon-secret" not found Jun 05 13:02:11.606311 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.606292 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:02:11.606610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.606591 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e392fa5-9946-46f7-981d-867021791d0e-original-pull-secret\") pod \"global-pull-secret-syncer-92c4b\" (UID: \"2e392fa5-9946-46f7-981d-867021791d0e\") " pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:02:11.616840 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.616815 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjqc5\" (UniqueName: \"kubernetes.io/projected/6f50b796-e674-4a8e-acb6-22736afbf68e-kube-api-access-cjqc5\") pod \"network-check-target-55hcn\" (UID: \"6f50b796-e674-4a8e-acb6-22736afbf68e\") " pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:02:11.769452 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.769428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92c4b" Jun 05 13:02:11.781970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.781949 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqt82\"" Jun 05 13:02:11.790838 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.790817 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:02:11.927469 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.927426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-92c4b"] Jun 05 13:02:11.930534 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:02:11.930503 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e392fa5_9946_46f7_981d_867021791d0e.slice/crio-ec55b46b2e4af150c6266871c7828b5be2df4354318452540a54294b92c0b710 WatchSource:0}: Error finding container ec55b46b2e4af150c6266871c7828b5be2df4354318452540a54294b92c0b710: Status 404 returned error can't find the container with id ec55b46b2e4af150c6266871c7828b5be2df4354318452540a54294b92c0b710 Jun 05 13:02:11.945756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.945729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-55hcn"] Jun 05 13:02:11.948567 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:02:11.948546 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f50b796_e674_4a8e_acb6_22736afbf68e.slice/crio-797fe5448ec08d2a84e2f21ca4bc26682e04627435c9562d48fd9a8cdbec7b1f WatchSource:0}: Error finding container 797fe5448ec08d2a84e2f21ca4bc26682e04627435c9562d48fd9a8cdbec7b1f: Status 404 returned error can't find the container with id 797fe5448ec08d2a84e2f21ca4bc26682e04627435c9562d48fd9a8cdbec7b1f Jun 05 13:02:11.998444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:11.998412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:02:11.998547 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:02:11.998507 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:02:11.998590 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:02:11.998563 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:43.998550552 +0000 UTC m=+98.690063505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:02:12.016304 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:12.016276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-92c4b" event={"ID":"2e392fa5-9946-46f7-981d-867021791d0e","Type":"ContainerStarted","Data":"ec55b46b2e4af150c6266871c7828b5be2df4354318452540a54294b92c0b710"} Jun 05 13:02:12.017343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:12.017323 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-55hcn" event={"ID":"6f50b796-e674-4a8e-acb6-22736afbf68e","Type":"ContainerStarted","Data":"797fe5448ec08d2a84e2f21ca4bc26682e04627435c9562d48fd9a8cdbec7b1f"} Jun 05 13:02:15.389840 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:15.389804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:15.444645 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:15.444598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:02:17.032377 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:17.032340 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-92c4b" event={"ID":"2e392fa5-9946-46f7-981d-867021791d0e","Type":"ContainerStarted","Data":"d95aa5b383c3f0203c08c1c180d6e898bc28791a8b91c58bdedffb4d797595d7"} Jun 05 13:02:17.037154 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:17.037118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-55hcn" event={"ID":"6f50b796-e674-4a8e-acb6-22736afbf68e","Type":"ContainerStarted","Data":"5138204f5c2e58232b6d7947fdc0b0cb0a74934cccb4ebbea1486beff5f877b2"} Jun 05 13:02:17.037292 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:17.037199 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:02:17.050966 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:17.050926 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-92c4b" podStartSLOduration=66.719845669 podStartE2EDuration="1m11.050915246s" totalImagesPullingTime="4.331069577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:17.05063966 +0000 UTC m=+71.742152635" watchObservedRunningTime="2026-06-05 13:02:17.050915246 +0000 UTC m=+71.742428221" Jun 05 13:02:17.064833 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:17.064789 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-55hcn" podStartSLOduration=67.763798304 podStartE2EDuration="1m12.064775037s" totalImagesPullingTime="4.300976733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:17.064687276 +0000 UTC m=+71.756200275" watchObservedRunningTime="2026-06-05 13:02:17.064775037 +0000 UTC m=+71.756288014" Jun 05 13:02:44.011573 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:44.011534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:02:44.011984 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:02:44.011676 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:02:44.011984 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:02:44.011750 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:03:48.011731605 +0000 UTC m=+162.703244577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:02:48.042769 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:02:48.042737 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-55hcn" Jun 05 13:03:15.623253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:03:15.623213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:03:15.623721 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:03:15.623357 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:03:15.623721 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:03:15.623430 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs podName:831af32a-8d08-45d3-a22f-10be956b2058 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:17.623411114 +0000 UTC m=+252.314924083 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs") pod "network-metrics-daemon-gnlk6" (UID: "831af32a-8d08-45d3-a22f-10be956b2058") : secret "metrics-daemon-secret" not found Jun 05 13:03:43.201425 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:03:43.201386 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9qxkm" podUID="6a00ab16-fe20-4cdf-8de9-c7405990f067" Jun 05 13:03:43.243312 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:03:43.243284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9qxkm" Jun 05 13:03:44.774386 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:03:44.774340 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gnlk6" podUID="831af32a-8d08-45d3-a22f-10be956b2058" Jun 05 13:03:48.027080 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:03:48.027029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:03:48.027480 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:03:48.027177 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:03:48.027480 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:03:48.027248 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls podName:6a00ab16-fe20-4cdf-8de9-c7405990f067 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:50.027230069 +0000 UTC m=+284.718743022 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls") pod "dns-default-9qxkm" (UID: "6a00ab16-fe20-4cdf-8de9-c7405990f067") : secret "dns-default-metrics-tls" not found Jun 05 13:03:51.334407 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:03:51.334366 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:03:57.759193 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:03:57.759082 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:04:00.989745 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:00.989700 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" podUID="58c87b6c-38c9-4b38-bb27-76ae588c01c6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 05 13:04:01.285595 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:01.285514 2558 generic.go:356] "Generic (PLEG): container finished" podID="58c87b6c-38c9-4b38-bb27-76ae588c01c6" containerID="f29c999a4a7d7565b0b517bb128691a437383784ce56f4528d31aff3320c4b9a" exitCode=1 Jun 05 13:04:01.285595 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:01.285569 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" event={"ID":"58c87b6c-38c9-4b38-bb27-76ae588c01c6","Type":"ContainerDied","Data":"f29c999a4a7d7565b0b517bb128691a437383784ce56f4528d31aff3320c4b9a"} Jun 05 13:04:01.285905 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:01.285889 2558 scope.go:117] "RemoveContainer" containerID="f29c999a4a7d7565b0b517bb128691a437383784ce56f4528d31aff3320c4b9a" Jun 05 13:04:02.289638 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:02.289603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" event={"ID":"58c87b6c-38c9-4b38-bb27-76ae588c01c6","Type":"ContainerStarted","Data":"59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782"} Jun 05 13:04:02.290057 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:02.289888 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:04:02.290486 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:02.290467 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:04:34.486863 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.486827 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf"] Jun 05 13:04:34.489064 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.489044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" Jun 05 13:04:34.491734 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.491715 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 13:04:34.492132 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.492118 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:04:34.492871 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.492852 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z4xg8\"" Jun 05 13:04:34.505442 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.505422 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69f77ddd98-59z9t"] Jun 05 13:04:34.507289 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.507271 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65699ffdbf-xcdnm"] Jun 05 13:04:34.507411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.507395 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.509074 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.509056 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf"] Jun 05 13:04:34.509176 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.509157 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.509791 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.509772 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 13:04:34.509928 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.509903 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 13:04:34.510079 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.510064 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47p46\"" Jun 05 13:04:34.510584 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.510565 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 13:04:34.512166 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512146 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 13:04:34.512166 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512164 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 13:04:34.512325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512205 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 13:04:34.512325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512259 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 13:04:34.512325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512157 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 13:04:34.512325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512265 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 13:04:34.512765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.512751 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h9l6x\"" Jun 05 13:04:34.516066 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.516046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 13:04:34.524916 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.524896 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f77ddd98-59z9t"] Jun 05 13:04:34.525582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.525561 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65699ffdbf-xcdnm"] Jun 05 13:04:34.532306 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-bound-sa-token\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532387 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-default-certificate\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.532387 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-stats-auth\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.532387 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.532485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6782p\" (UniqueName: \"kubernetes.io/projected/72944760-a737-4108-844a-9ef4601f6a70-kube-api-access-6782p\") pod \"volume-data-source-validator-78dd696465-4jpbf\" (UID: \"72944760-a737-4108-844a-9ef4601f6a70\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" Jun 05 13:04:34.532485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-image-registry-private-configuration\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532495 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-registry-certificates\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4824da39-6448-4844-8a8c-5efbfe658710-ca-trust-extracted\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-installation-pull-secrets\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hd2j\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-kube-api-access-5hd2j\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.532723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-trusted-ca\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.532723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.532597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4m8\" (UniqueName: \"kubernetes.io/projected/bb71982d-95ac-4106-bc2d-27e1d313ccb9-kube-api-access-cv4m8\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.633338 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-default-certificate\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.633500 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-stats-auth\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.633500 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.633500 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6782p\" (UniqueName: \"kubernetes.io/projected/72944760-a737-4108-844a-9ef4601f6a70-kube-api-access-6782p\") pod \"volume-data-source-validator-78dd696465-4jpbf\" (UID: \"72944760-a737-4108-844a-9ef4601f6a70\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" Jun 05 13:04:34.633500 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-image-registry-private-configuration\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.633500 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.633467 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.633548 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:35.133527978 +0000 UTC m=+209.825040931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : secret "router-metrics-certs-default" not found Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.633610 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.633625 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f77ddd98-59z9t: secret "image-registry-tls" not found Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.633669 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls podName:4824da39-6448-4844-8a8c-5efbfe658710 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:35.133653265 +0000 UTC m=+209.825166229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls") pod "image-registry-69f77ddd98-59z9t" (UID: "4824da39-6448-4844-8a8c-5efbfe658710") : secret "image-registry-tls" not found Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-registry-certificates\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4824da39-6448-4844-8a8c-5efbfe658710-ca-trust-extracted\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.633757 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-installation-pull-secrets\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.634224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hd2j\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-kube-api-access-5hd2j\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.634224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.634224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-trusted-ca\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.634224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4m8\" (UniqueName: \"kubernetes.io/projected/bb71982d-95ac-4106-bc2d-27e1d313ccb9-kube-api-access-cv4m8\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.634224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.633933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-bound-sa-token\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.634224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.634123 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4824da39-6448-4844-8a8c-5efbfe658710-ca-trust-extracted\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.634518 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.634245 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:35.134230062 +0000 UTC m=+209.825743032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : configmap references non-existent config key: service-ca.crt Jun 05 13:04:34.634518 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.634454 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-registry-certificates\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.634965 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.634935 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-trusted-ca\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.636156 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.636134 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-image-registry-private-configuration\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.636265 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.636238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-stats-auth\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.636459 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.636442 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-default-certificate\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.636633 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.636618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-installation-pull-secrets\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.650155 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.650133 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6782p\" (UniqueName: \"kubernetes.io/projected/72944760-a737-4108-844a-9ef4601f6a70-kube-api-access-6782p\") pod \"volume-data-source-validator-78dd696465-4jpbf\" (UID: \"72944760-a737-4108-844a-9ef4601f6a70\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" Jun 05 13:04:34.658415 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.658394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-bound-sa-token\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.658628 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.658609 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hd2j\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-kube-api-access-5hd2j\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:34.665390 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.665373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4m8\" (UniqueName: \"kubernetes.io/projected/bb71982d-95ac-4106-bc2d-27e1d313ccb9-kube-api-access-cv4m8\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:34.687065 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.687039 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-5t2lj"] Jun 05 13:04:34.689469 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.689453 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh"] Jun 05 13:04:34.689597 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.689582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.691338 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.691324 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:34.692567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.692549 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 13:04:34.692734 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.692719 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 13:04:34.692979 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.692964 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6cndl\"" Jun 05 13:04:34.693091 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.693075 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 13:04:34.693455 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.693413 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 13:04:34.693455 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.693435 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qpzhz\"" Jun 05 13:04:34.693682 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.693476 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 13:04:34.693682 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.693567 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 13:04:34.693682 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.693627 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:04:34.698084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.698064 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 13:04:34.700432 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.700417 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh"] Jun 05 13:04:34.701147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.701132 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5t2lj"] Jun 05 13:04:34.732128 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.732081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:34.734528 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c76abce-52fc-490e-a23e-c08c4509f1b9-serving-cert\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.734630 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734543 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxbd\" (UniqueName: \"kubernetes.io/projected/d1bcc0f1-308d-476e-818d-7fa2391cc956-kube-api-access-6bxbd\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:34.734630 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrk9j\" (UniqueName: \"kubernetes.io/projected/1c76abce-52fc-490e-a23e-c08c4509f1b9-kube-api-access-qrk9j\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.734716 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c76abce-52fc-490e-a23e-c08c4509f1b9-service-ca-bundle\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.734750 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c76abce-52fc-490e-a23e-c08c4509f1b9-tmp\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.734800 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c76abce-52fc-490e-a23e-c08c4509f1b9-trusted-ca-bundle\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.734891 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c76abce-52fc-490e-a23e-c08c4509f1b9-snapshots\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.734891 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.734833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:34.793253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.793169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:34.797139 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.797125 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" Jun 05 13:04:34.835249 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:34.835355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c76abce-52fc-490e-a23e-c08c4509f1b9-serving-cert\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.835355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxbd\" (UniqueName: \"kubernetes.io/projected/d1bcc0f1-308d-476e-818d-7fa2391cc956-kube-api-access-6bxbd\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:34.835355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835312 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrk9j\" (UniqueName: \"kubernetes.io/projected/1c76abce-52fc-490e-a23e-c08c4509f1b9-kube-api-access-qrk9j\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.835355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c76abce-52fc-490e-a23e-c08c4509f1b9-service-ca-bundle\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.835489 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.835360 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:04:34.835489 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c76abce-52fc-490e-a23e-c08c4509f1b9-tmp\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.835489 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:34.835429 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls podName:d1bcc0f1-308d-476e-818d-7fa2391cc956 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:35.335409338 +0000 UTC m=+210.026922304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hz2zh" (UID: "d1bcc0f1-308d-476e-818d-7fa2391cc956") : secret "samples-operator-tls" not found Jun 05 13:04:34.835489 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c76abce-52fc-490e-a23e-c08c4509f1b9-trusted-ca-bundle\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.835618 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c76abce-52fc-490e-a23e-c08c4509f1b9-snapshots\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.835941 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.835922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c76abce-52fc-490e-a23e-c08c4509f1b9-tmp\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.836084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.836065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c76abce-52fc-490e-a23e-c08c4509f1b9-snapshots\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.836305 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.836283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c76abce-52fc-490e-a23e-c08c4509f1b9-service-ca-bundle\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.836499 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.836478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c76abce-52fc-490e-a23e-c08c4509f1b9-trusted-ca-bundle\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.837637 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.837621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c76abce-52fc-490e-a23e-c08c4509f1b9-serving-cert\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.844251 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.844230 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrk9j\" (UniqueName: \"kubernetes.io/projected/1c76abce-52fc-490e-a23e-c08c4509f1b9-kube-api-access-qrk9j\") pod \"insights-operator-896549976-5t2lj\" (UID: \"1c76abce-52fc-490e-a23e-c08c4509f1b9\") " pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:34.844464 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.844443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxbd\" (UniqueName: \"kubernetes.io/projected/d1bcc0f1-308d-476e-818d-7fa2391cc956-kube-api-access-6bxbd\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:34.892604 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.892569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:34.914439 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:34.914410 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf"] Jun 05 13:04:34.917286 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:04:34.917261 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72944760_a737_4108_844a_9ef4601f6a70.slice/crio-59e2568ddabe7ab045f41bc63c2417dd61714574db1facbab0dcd8bd68a80335 WatchSource:0}: Error finding container 59e2568ddabe7ab045f41bc63c2417dd61714574db1facbab0dcd8bd68a80335: Status 404 returned error can't find the container with id 59e2568ddabe7ab045f41bc63c2417dd61714574db1facbab0dcd8bd68a80335 Jun 05 13:04:35.000496 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.000467 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5t2lj" Jun 05 13:04:35.119573 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.119542 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5t2lj"] Jun 05 13:04:35.122639 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:04:35.122614 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c76abce_52fc_490e_a23e_c08c4509f1b9.slice/crio-e45f57c09272bcaac18cc0e27fc0fa3db1fd8bae24c57ee3bd7b6134b8aa4b44 WatchSource:0}: Error finding container e45f57c09272bcaac18cc0e27fc0fa3db1fd8bae24c57ee3bd7b6134b8aa4b44: Status 404 returned error can't find the container with id e45f57c09272bcaac18cc0e27fc0fa3db1fd8bae24c57ee3bd7b6134b8aa4b44 Jun 05 13:04:35.137357 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.137336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:35.137444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.137367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:35.137444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.137429 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:35.137517 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.137468 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:04:35.137517 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.137484 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f77ddd98-59z9t: secret "image-registry-tls" not found Jun 05 13:04:35.137517 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.137514 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:04:35.137645 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.137542 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls podName:4824da39-6448-4844-8a8c-5efbfe658710 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:36.137525979 +0000 UTC m=+210.829038935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls") pod "image-registry-69f77ddd98-59z9t" (UID: "4824da39-6448-4844-8a8c-5efbfe658710") : secret "image-registry-tls" not found Jun 05 13:04:35.137645 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.137555 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:36.137549852 +0000 UTC m=+210.829062805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : secret "router-metrics-certs-default" not found Jun 05 13:04:35.137645 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.137606 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:36.137586898 +0000 UTC m=+210.829099853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : configmap references non-existent config key: service-ca.crt Jun 05 13:04:35.342442 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.339414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:35.342442 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.339575 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:04:35.342442 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:35.339645 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls podName:d1bcc0f1-308d-476e-818d-7fa2391cc956 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:36.339626854 +0000 UTC m=+211.031139823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hz2zh" (UID: "d1bcc0f1-308d-476e-818d-7fa2391cc956") : secret "samples-operator-tls" not found Jun 05 13:04:35.387441 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.387399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5t2lj" event={"ID":"1c76abce-52fc-490e-a23e-c08c4509f1b9","Type":"ContainerStarted","Data":"e45f57c09272bcaac18cc0e27fc0fa3db1fd8bae24c57ee3bd7b6134b8aa4b44"} Jun 05 13:04:35.388369 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:35.388345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" event={"ID":"72944760-a737-4108-844a-9ef4601f6a70","Type":"ContainerStarted","Data":"59e2568ddabe7ab045f41bc63c2417dd61714574db1facbab0dcd8bd68a80335"} Jun 05 13:04:36.147510 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:36.147452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:36.147510 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:36.147507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:36.147564 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.147626 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.147650 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f77ddd98-59z9t: secret "image-registry-tls" not found Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.147693 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.147717 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls podName:4824da39-6448-4844-8a8c-5efbfe658710 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:38.147696142 +0000 UTC m=+212.839209112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls") pod "image-registry-69f77ddd98-59z9t" (UID: "4824da39-6448-4844-8a8c-5efbfe658710") : secret "image-registry-tls" not found Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.147745 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:38.147729606 +0000 UTC m=+212.839242562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : secret "router-metrics-certs-default" not found Jun 05 13:04:36.148023 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.147762 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:38.147752498 +0000 UTC m=+212.839265457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : configmap references non-existent config key: service-ca.crt Jun 05 13:04:36.349582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:36.349540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:36.349771 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.349708 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:04:36.349841 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:36.349800 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls podName:d1bcc0f1-308d-476e-818d-7fa2391cc956 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:38.349777304 +0000 UTC m=+213.041290260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hz2zh" (UID: "d1bcc0f1-308d-476e-818d-7fa2391cc956") : secret "samples-operator-tls" not found Jun 05 13:04:37.395591 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:37.395555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" event={"ID":"72944760-a737-4108-844a-9ef4601f6a70","Type":"ContainerStarted","Data":"8ef8b07d7c11b772355c42ac230c3d61436fd69552154229a747a1f3552fe7cb"} Jun 05 13:04:37.397113 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:37.397078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5t2lj" event={"ID":"1c76abce-52fc-490e-a23e-c08c4509f1b9","Type":"ContainerStarted","Data":"f3c1af38bbf4390639a7e16e34d493b8e31a3dabbe57fb661fe09b40f3ec6198"} Jun 05 13:04:37.410677 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:37.410633 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4jpbf" podStartSLOduration=1.972302543 podStartE2EDuration="3.410620442s" totalImagesPullingTime="1.438317899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:04:37.410385909 +0000 UTC m=+212.101898898" watchObservedRunningTime="2026-06-05 13:04:37.410620442 +0000 UTC m=+212.102133416" Jun 05 13:04:37.426914 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:37.426868 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-5t2lj" podStartSLOduration=1.339265917 podStartE2EDuration="3.426853732s" totalImagesPullingTime="2.087587815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:04:37.425951872 +0000 UTC m=+212.117464861" watchObservedRunningTime="2026-06-05 13:04:37.426853732 +0000 UTC m=+212.118366728" Jun 05 13:04:37.504483 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:37.504415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:38.166024 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:38.165984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:38.166227 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:38.166037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:38.166227 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:38.166088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:38.166227 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.166159 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:04:38.166227 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.166180 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f77ddd98-59z9t: secret "image-registry-tls" not found Jun 05 13:04:38.166407 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.166242 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:42.166218221 +0000 UTC m=+216.857731191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : configmap references non-existent config key: service-ca.crt Jun 05 13:04:38.166407 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.166271 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls podName:4824da39-6448-4844-8a8c-5efbfe658710 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:42.166259868 +0000 UTC m=+216.857772820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls") pod "image-registry-69f77ddd98-59z9t" (UID: "4824da39-6448-4844-8a8c-5efbfe658710") : secret "image-registry-tls" not found Jun 05 13:04:38.166407 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.166243 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:04:38.166407 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.166315 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:42.16630635 +0000 UTC m=+216.857819321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : secret "router-metrics-certs-default" not found Jun 05 13:04:38.367582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:38.367545 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:38.367733 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.367698 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:04:38.367781 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:38.367771 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls podName:d1bcc0f1-308d-476e-818d-7fa2391cc956 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:42.367750285 +0000 UTC m=+217.059263255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hz2zh" (UID: "d1bcc0f1-308d-476e-818d-7fa2391cc956") : secret "samples-operator-tls" not found Jun 05 13:04:38.406127 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:38.406069 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:38.503419 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:38.503390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:39.525482 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.525452 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:39.632454 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.632422 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kx6xz"] Jun 05 13:04:39.634765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.634749 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.636944 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.636921 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwxx2\"" Jun 05 13:04:39.637056 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.636948 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 13:04:39.637620 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.637606 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 13:04:39.646859 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.646838 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kx6xz"] Jun 05 13:04:39.677759 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.677733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56e26b3c-e2a7-4cd1-8f30-8901dad12390-data-volume\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.677853 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.677797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8dg\" (UniqueName: \"kubernetes.io/projected/56e26b3c-e2a7-4cd1-8f30-8901dad12390-kube-api-access-4x8dg\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.677853 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.677849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56e26b3c-e2a7-4cd1-8f30-8901dad12390-crio-socket\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.677970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.677871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e26b3c-e2a7-4cd1-8f30-8901dad12390-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.678026 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.677985 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.777325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.777241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:39.778326 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.778433 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56e26b3c-e2a7-4cd1-8f30-8901dad12390-data-volume\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.778433 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8dg\" (UniqueName: \"kubernetes.io/projected/56e26b3c-e2a7-4cd1-8f30-8901dad12390-kube-api-access-4x8dg\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.778554 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:39.778433 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:39.778554 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:39.778486 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls podName:56e26b3c-e2a7-4cd1-8f30-8901dad12390 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:40.27846893 +0000 UTC m=+214.969981890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx6xz" (UID: "56e26b3c-e2a7-4cd1-8f30-8901dad12390") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:39.778554 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56e26b3c-e2a7-4cd1-8f30-8901dad12390-crio-socket\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.778554 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e26b3c-e2a7-4cd1-8f30-8901dad12390-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.778711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778612 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56e26b3c-e2a7-4cd1-8f30-8901dad12390-crio-socket\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.778711 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56e26b3c-e2a7-4cd1-8f30-8901dad12390-data-volume\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.779004 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.778987 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56e26b3c-e2a7-4cd1-8f30-8901dad12390-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:39.786817 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:39.786798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8dg\" (UniqueName: \"kubernetes.io/projected/56e26b3c-e2a7-4cd1-8f30-8901dad12390-kube-api-access-4x8dg\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:40.010704 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.010672 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:40.065864 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.065795 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:40.283026 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.282989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:40.283200 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:40.283150 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:40.283245 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:40.283216 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls podName:56e26b3c-e2a7-4cd1-8f30-8901dad12390 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:41.283201886 +0000 UTC m=+215.974714838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx6xz" (UID: "56e26b3c-e2a7-4cd1-8f30-8901dad12390") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:40.320664 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.320612 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6mbd_c8c417c3-66f0-49cd-a8f5-e8a4eb00d657/dns-node-resolver/0.log" Jun 05 13:04:40.489200 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.489170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:40.587556 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.587483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:40.697800 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.697770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:40.786894 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.786867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:40.887330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:40.887258 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:41.291419 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:41.291389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:41.291570 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:41.291499 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:41.291570 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:41.291556 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls podName:56e26b3c-e2a7-4cd1-8f30-8901dad12390 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:43.291540116 +0000 UTC m=+217.983053070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx6xz" (UID: "56e26b3c-e2a7-4cd1-8f30-8901dad12390") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:41.521410 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:41.521382 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nr54c_19bdefc7-f77d-4dcc-ba01-f2cdddf63112/node-ca/0.log" Jun 05 13:04:41.920971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:41.920947 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clnk2_bdd3098c-6ec6-4068-8990-590cb87e218d/serve-healthcheck-canary/0.log" Jun 05 13:04:42.124470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.124441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:42.188430 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.188350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:42.199492 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.199468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:42.199559 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.199505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:42.199559 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.199541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:42.199652 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.199600 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:04:42.199652 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.199615 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f77ddd98-59z9t: secret "image-registry-tls" not found Jun 05 13:04:42.199737 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.199661 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:04:42.199737 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.199667 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls podName:4824da39-6448-4844-8a8c-5efbfe658710 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:50.199652507 +0000 UTC m=+224.891165460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls") pod "image-registry-69f77ddd98-59z9t" (UID: "4824da39-6448-4844-8a8c-5efbfe658710") : secret "image-registry-tls" not found Jun 05 13:04:42.199737 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.199708 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:50.199696038 +0000 UTC m=+224.891208993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : secret "router-metrics-certs-default" not found Jun 05 13:04:42.199737 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.199722 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:50.199712813 +0000 UTC m=+224.891225767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : configmap references non-existent config key: service-ca.crt Jun 05 13:04:42.401047 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.401010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:42.401224 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.401143 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:04:42.401224 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:42.401196 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls podName:d1bcc0f1-308d-476e-818d-7fa2391cc956 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:50.401184137 +0000 UTC m=+225.092697090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hz2zh" (UID: "d1bcc0f1-308d-476e-818d-7fa2391cc956") : secret "samples-operator-tls" not found Jun 05 13:04:42.702522 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.702490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:42.764083 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:42.764051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:43.308088 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:43.308051 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:43.308507 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:43.308198 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:43.308507 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:43.308257 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls podName:56e26b3c-e2a7-4cd1-8f30-8901dad12390 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:47.308243153 +0000 UTC m=+221.999756106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx6xz" (UID: "56e26b3c-e2a7-4cd1-8f30-8901dad12390") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:43.394451 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:43.394422 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:44.120473 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:44.120439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:44.321325 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:44.321289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:44.551067 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:44.551036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:44.651503 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:44.651447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:44.810411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:44.810293 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:45.614353 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:45.614320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:45.727249 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:45.727171 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:46.012718 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:46.012667 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:46.213793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:46.213761 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:46.819597 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:46.819519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:47.338146 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:47.338092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:47.338352 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:47.338228 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:47.338352 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:47.338302 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls podName:56e26b3c-e2a7-4cd1-8f30-8901dad12390 nodeName:}" failed. No retries permitted until 2026-06-05 13:04:55.338288244 +0000 UTC m=+230.029801199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kx6xz" (UID: "56e26b3c-e2a7-4cd1-8f30-8901dad12390") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:47.428274 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:47.428241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:47.612010 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:47.611939 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:47.816260 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:47.816231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:48.016516 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:48.016486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:48.214006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:48.213969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:48.315547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:48.315474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:48.814457 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:48.814432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:49.411566 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:49.411533 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:49.611696 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:49.611669 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:49.819489 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:49.819453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:50.211686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.211652 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:50.256802 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.256776 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:50.256922 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.256826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:50.256922 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.256890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:50.257036 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:04:50.256954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle podName:bb71982d-95ac-4106-bc2d-27e1d313ccb9 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:06.256932328 +0000 UTC m=+240.948445283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle") pod "router-default-65699ffdbf-xcdnm" (UID: "bb71982d-95ac-4106-bc2d-27e1d313ccb9") : configmap references non-existent config key: service-ca.crt Jun 05 13:04:50.259199 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.259178 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"image-registry-69f77ddd98-59z9t\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:50.259315 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.259180 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb71982d-95ac-4106-bc2d-27e1d313ccb9-metrics-certs\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:04:50.418259 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.418225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:50.459171 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.459143 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:50.461402 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.461383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1bcc0f1-308d-476e-818d-7fa2391cc956-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hz2zh\" (UID: \"d1bcc0f1-308d-476e-818d-7fa2391cc956\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:50.545470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.545438 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f77ddd98-59z9t"] Jun 05 13:04:50.548552 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:04:50.548526 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4824da39_6448_4844_8a8c_5efbfe658710.slice/crio-c44211b28396fe952453129aeb59fd4a1eac663b7be5c3851ecbb86b07874e24 WatchSource:0}: Error finding container c44211b28396fe952453129aeb59fd4a1eac663b7be5c3851ecbb86b07874e24: Status 404 returned error can't find the container with id c44211b28396fe952453129aeb59fd4a1eac663b7be5c3851ecbb86b07874e24 Jun 05 13:04:50.605951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.605932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" Jun 05 13:04:50.663991 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.663961 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:50.726240 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:50.726163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh"] Jun 05 13:04:51.011951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.011871 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:51.217500 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.217468 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:51.438473 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.438391 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" event={"ID":"d1bcc0f1-308d-476e-818d-7fa2391cc956","Type":"ContainerStarted","Data":"1988a65025f510509d8da37b22bd3450add154af0356e7a3db2687581baf6562"} Jun 05 13:04:51.440118 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.440079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" event={"ID":"4824da39-6448-4844-8a8c-5efbfe658710","Type":"ContainerStarted","Data":"e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e"} Jun 05 13:04:51.440251 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.440140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" event={"ID":"4824da39-6448-4844-8a8c-5efbfe658710","Type":"ContainerStarted","Data":"c44211b28396fe952453129aeb59fd4a1eac663b7be5c3851ecbb86b07874e24"} Jun 05 13:04:51.440251 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.440181 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:04:51.468115 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.468048 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" podStartSLOduration=17.468031636 podStartE2EDuration="17.468031636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:04:51.466748682 +0000 UTC m=+226.158261660" watchObservedRunningTime="2026-06-05 13:04:51.468031636 +0000 UTC m=+226.159544612" Jun 05 13:04:51.613719 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.613689 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:51.814370 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:51.814326 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:52.022086 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:52.022054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:52.819561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:52.819475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:53.214507 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:53.214477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:53.447841 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:53.447807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" event={"ID":"d1bcc0f1-308d-476e-818d-7fa2391cc956","Type":"ContainerStarted","Data":"643990d2e8785a0e6fafe50da85a9cec002ea1cf8d08c33192354782f9e0ecde"} Jun 05 13:04:53.448001 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:53.447856 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" event={"ID":"d1bcc0f1-308d-476e-818d-7fa2391cc956","Type":"ContainerStarted","Data":"2555da6f2868c7b2e47b9ea5dd46e720631c9acf1496cc3cbdec004eec9bf0d4"} Jun 05 13:04:53.466313 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:53.466231 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hz2zh" podStartSLOduration=17.684259783 podStartE2EDuration="19.466216046s" totalImagesPullingTime="1.781956263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:04:53.465032647 +0000 UTC m=+228.156545623" watchObservedRunningTime="2026-06-05 13:04:53.466216046 +0000 UTC m=+228.157729020" Jun 05 13:04:53.623938 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:53.623904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:54.018992 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:54.018961 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:54.458410 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:54.458379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:54.613262 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:54.613231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:54.821842 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:54.821760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:55.288676 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:55.288647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:55.397505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:55.397473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:55.399721 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:55.399698 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56e26b3c-e2a7-4cd1-8f30-8901dad12390-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kx6xz\" (UID: \"56e26b3c-e2a7-4cd1-8f30-8901dad12390\") " pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:55.543688 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:55.543609 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kx6xz" Jun 05 13:04:55.663414 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:55.663226 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kx6xz"] Jun 05 13:04:55.666169 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:04:55.666144 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e26b3c_e2a7_4cd1_8f30_8901dad12390.slice/crio-80f98eac84c8255eaf16d668e51b8655ae727ccbff0d9da1ce8318bfa2de1ff8 WatchSource:0}: Error finding container 80f98eac84c8255eaf16d668e51b8655ae727ccbff0d9da1ce8318bfa2de1ff8: Status 404 returned error can't find the container with id 80f98eac84c8255eaf16d668e51b8655ae727ccbff0d9da1ce8318bfa2de1ff8 Jun 05 13:04:56.457809 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:56.457775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx6xz" event={"ID":"56e26b3c-e2a7-4cd1-8f30-8901dad12390","Type":"ContainerStarted","Data":"8efb314073454bbdc731d7c899e06c5538adee10ac938f5962c716aa7b548364"} Jun 05 13:04:56.458188 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:56.457856 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx6xz" event={"ID":"56e26b3c-e2a7-4cd1-8f30-8901dad12390","Type":"ContainerStarted","Data":"d7ee354daf1182254c5c8f70ab997835a642e557d57001e9d733fe07a34e933f"} Jun 05 13:04:56.458188 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:56.457877 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx6xz" event={"ID":"56e26b3c-e2a7-4cd1-8f30-8901dad12390","Type":"ContainerStarted","Data":"80f98eac84c8255eaf16d668e51b8655ae727ccbff0d9da1ce8318bfa2de1ff8"} Jun 05 13:04:57.699960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:57.699907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:57.755186 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:57.755159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:04:58.465773 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:58.465740 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kx6xz" event={"ID":"56e26b3c-e2a7-4cd1-8f30-8901dad12390","Type":"ContainerStarted","Data":"8e3bb21ce1aea459cc0868672c9cd66004046e68158ec6de07ba2ffea1a3781c"} Jun 05 13:04:58.483137 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:04:58.483076 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kx6xz" podStartSLOduration=17.478142723 podStartE2EDuration="19.483064374s" totalImagesPullingTime="2.004921651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:04:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:04:58.482091755 +0000 UTC m=+233.173604731" watchObservedRunningTime="2026-06-05 13:04:58.483064374 +0000 UTC m=+233.174577348" Jun 05 13:05:02.739857 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:02.739825 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69f77ddd98-59z9t"] Jun 05 13:05:02.840578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:02.840545 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:02.939865 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:02.939836 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:06.278569 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:06.278527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:06.279063 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:06.279045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71982d-95ac-4106-bc2d-27e1d313ccb9-service-ca-bundle\") pod \"router-default-65699ffdbf-xcdnm\" (UID: \"bb71982d-95ac-4106-bc2d-27e1d313ccb9\") " pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:06.324808 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:06.324785 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h9l6x\"" Jun 05 13:05:06.333490 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:06.333473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:06.462440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:06.462338 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65699ffdbf-xcdnm"] Jun 05 13:05:06.465034 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:06.465004 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb71982d_95ac_4106_bc2d_27e1d313ccb9.slice/crio-0ab2218d005f14126db3c279e10d5174b70e1e4d2f854a532f95a3e574baf76e WatchSource:0}: Error finding container 0ab2218d005f14126db3c279e10d5174b70e1e4d2f854a532f95a3e574baf76e: Status 404 returned error can't find the container with id 0ab2218d005f14126db3c279e10d5174b70e1e4d2f854a532f95a3e574baf76e Jun 05 13:05:06.491027 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:06.491000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" event={"ID":"bb71982d-95ac-4106-bc2d-27e1d313ccb9","Type":"ContainerStarted","Data":"0ab2218d005f14126db3c279e10d5174b70e1e4d2f854a532f95a3e574baf76e"} Jun 05 13:05:07.495374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:07.495343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" event={"ID":"bb71982d-95ac-4106-bc2d-27e1d313ccb9","Type":"ContainerStarted","Data":"86bada8e48819038254ecf2b87d52388f56dc8773307259eef36461bd9009237"} Jun 05 13:05:07.513320 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:07.513272 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" podStartSLOduration=33.513256943 podStartE2EDuration="33.513256943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:07.513150853 +0000 UTC m=+242.204663825" watchObservedRunningTime="2026-06-05 13:05:07.513256943 +0000 UTC m=+242.204769918" Jun 05 13:05:08.334451 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:08.334416 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:08.336777 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:08.336750 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:08.498523 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:08.498495 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:08.499708 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:08.499688 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65699ffdbf-xcdnm" Jun 05 13:05:08.817238 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:08.817207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:08.873286 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:08.873215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:09.296464 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:09.296432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:09.452709 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:09.452680 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:09.597299 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:09.597224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:12.745551 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:12.745517 2558 patch_prober.go:28] interesting pod/image-registry-69f77ddd98-59z9t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:12.745983 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:12.745577 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" podUID="4824da39-6448-4844-8a8c-5efbfe658710" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:13.488201 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.488163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:13.522196 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.522170 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg"] Jun 05 13:05:13.525142 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.525126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.527517 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.527498 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 13:05:13.527610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.527552 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 13:05:13.527666 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.527610 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 13:05:13.528790 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.528773 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 13:05:13.528877 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.528809 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dp796\"" Jun 05 13:05:13.528877 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.528827 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 13:05:13.534475 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.534399 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg"] Jun 05 13:05:13.550707 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.550657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:13.635940 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.635906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzvp\" (UniqueName: \"kubernetes.io/projected/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-kube-api-access-jzzvp\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.636069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.635958 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.636069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.636019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.636174 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.636073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.737154 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.737117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzvp\" (UniqueName: \"kubernetes.io/projected/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-kube-api-access-jzzvp\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.737253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.737175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.737253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.737200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.737253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.737237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.737397 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:13.737383 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 13:05:13.737448 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:13.737445 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-tls podName:2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e nodeName:}" failed. No retries permitted until 2026-06-05 13:05:14.237431643 +0000 UTC m=+248.928944596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-sbdrg" (UID: "2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e") : secret "prometheus-operator-tls" not found Jun 05 13:05:13.737801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.737781 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.739555 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.739506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.747973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.747954 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzvp\" (UniqueName: \"kubernetes.io/projected/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-kube-api-access-jzzvp\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:13.835457 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:13.835420 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:14.240720 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.240688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:14.243011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.242977 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sbdrg\" (UID: \"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:14.280328 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.280298 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:14.331801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.331763 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:14.434192 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.434156 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" Jun 05 13:05:14.554540 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.554520 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg"] Jun 05 13:05:14.556699 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:14.556674 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2e0b4a_038b_4b89_8b1b_04c26b28ed8e.slice/crio-db0600962f98f7a2fc66b888109575fd2da62309230b31d03f499a7c4d425db3 WatchSource:0}: Error finding container db0600962f98f7a2fc66b888109575fd2da62309230b31d03f499a7c4d425db3: Status 404 returned error can't find the container with id db0600962f98f7a2fc66b888109575fd2da62309230b31d03f499a7c4d425db3 Jun 05 13:05:14.834554 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.834447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:14.892126 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:14.892082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:15.522621 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:15.522590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" event={"ID":"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e","Type":"ContainerStarted","Data":"db0600962f98f7a2fc66b888109575fd2da62309230b31d03f499a7c4d425db3"} Jun 05 13:05:16.301225 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:16.301178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:16.527179 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:16.527145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" event={"ID":"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e","Type":"ContainerStarted","Data":"07ff9c8a8d891f89d7bc4eb93a0b37be86ef22caf0ea19b65a22b65b4e2e6d1f"} Jun 05 13:05:16.527367 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:16.527204 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" event={"ID":"2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e","Type":"ContainerStarted","Data":"4c7d425c3e616080be5d2b4ee852df1b7fe4b5093df3e9ec15b56d14d31c939d"} Jun 05 13:05:16.544969 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:16.544922 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sbdrg" podStartSLOduration=2.044930353 podStartE2EDuration="3.544907043s" totalImagesPullingTime="1.49997669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:16.543153384 +0000 UTC m=+251.234666359" watchObservedRunningTime="2026-06-05 13:05:16.544907043 +0000 UTC m=+251.236420018" Jun 05 13:05:17.666606 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.666569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:05:17.668979 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.668956 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/831af32a-8d08-45d3-a22f-10be956b2058-metrics-certs\") pod \"network-metrics-daemon-gnlk6\" (UID: \"831af32a-8d08-45d3-a22f-10be956b2058\") " pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:05:17.800062 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.800028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:17.862448 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.862421 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v8nr\"" Jun 05 13:05:17.866941 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.866916 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:17.870479 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.870457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnlk6" Jun 05 13:05:17.934661 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:17.934589 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.019744 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.019710 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnlk6"] Jun 05 13:05:18.022717 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:18.022692 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831af32a_8d08_45d3_a22f_10be956b2058.slice/crio-932864318b7fcebcb59c16bce110ffc797f6e1c06a93873169b57ec64c614a44 WatchSource:0}: Error finding container 932864318b7fcebcb59c16bce110ffc797f6e1c06a93873169b57ec64c614a44: Status 404 returned error can't find the container with id 932864318b7fcebcb59c16bce110ffc797f6e1c06a93873169b57ec64c614a44 Jun 05 13:05:18.063311 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.063287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.120523 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.120500 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.280914 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.280889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.535546 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.535459 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnlk6" event={"ID":"831af32a-8d08-45d3-a22f-10be956b2058","Type":"ContainerStarted","Data":"932864318b7fcebcb59c16bce110ffc797f6e1c06a93873169b57ec64c614a44"} Jun 05 13:05:18.621188 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.621152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.720888 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.720858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.837338 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.837309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.859746 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.859709 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg"] Jun 05 13:05:18.862148 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.862126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:18.865082 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.865061 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 13:05:18.865206 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.865134 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m8shk\"" Jun 05 13:05:18.865366 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.865349 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 13:05:18.876795 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.876773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg"] Jun 05 13:05:18.890333 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.888358 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p7w9l"] Jun 05 13:05:18.891593 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.891572 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.894330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.894299 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 13:05:18.894330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.894324 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 13:05:18.894466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.894352 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 13:05:18.894466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.894377 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwt48\"" Jun 05 13:05:18.907091 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.906943 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz"] Jun 05 13:05:18.909418 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.909399 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:18.911723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.911708 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 13:05:18.912067 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.912047 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 13:05:18.912182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.912048 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4wjjr\"" Jun 05 13:05:18.912182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.912088 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 13:05:18.920130 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.920092 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz"] Jun 05 13:05:18.940810 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.940785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:18.976789 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69djz\" (UniqueName: \"kubernetes.io/projected/18bb62cb-8606-4626-ab13-506ff53f1088-kube-api-access-69djz\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.976887 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-sys\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.976887 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.976887 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ade602c1-00be-49db-959a-6efd1e877c9b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:18.976984 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-root\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.976984 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.976984 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18bb62cb-8606-4626-ab13-506ff53f1088-metrics-client-ca\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.977076 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.976995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-textfile\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.977076 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.977020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade602c1-00be-49db-959a-6efd1e877c9b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:18.977162 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.977081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-tls\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.977162 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.977118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-wtmp\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:18.977162 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.977144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4lrw\" (UniqueName: \"kubernetes.io/projected/ade602c1-00be-49db-959a-6efd1e877c9b-kube-api-access-b4lrw\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:18.977251 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:18.977164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ade602c1-00be-49db-959a-6efd1e877c9b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.032636 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.032609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.078450 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-tls\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.078565 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-wtmp\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.078565 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4lrw\" (UniqueName: \"kubernetes.io/projected/ade602c1-00be-49db-959a-6efd1e877c9b-kube-api-access-b4lrw\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.078565 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f27929ce-2303-49e0-ab32-1ae3f60652b8-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.078565 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ade602c1-00be-49db-959a-6efd1e877c9b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.078565 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69djz\" (UniqueName: \"kubernetes.io/projected/18bb62cb-8606-4626-ab13-506ff53f1088-kube-api-access-69djz\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27929ce-2303-49e0-ab32-1ae3f60652b8-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078610 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-wtmp\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:19.078620 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-sys\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:19.078769 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-tls podName:18bb62cb-8606-4626-ab13-506ff53f1088 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:19.578748844 +0000 UTC m=+254.270261807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-tls") pod "node-exporter-p7w9l" (UID: "18bb62cb-8606-4626-ab13-506ff53f1088") : secret "node-exporter-tls" not found Jun 05 13:05:19.078812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-sys\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7w9j\" (UniqueName: \"kubernetes.io/projected/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-api-access-h7w9j\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ade602c1-00be-49db-959a-6efd1e877c9b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.078981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-root\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18bb62cb-8606-4626-ab13-506ff53f1088-metrics-client-ca\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.079160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18bb62cb-8606-4626-ab13-506ff53f1088-root\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079560 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-textfile\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079560 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade602c1-00be-49db-959a-6efd1e877c9b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.079560 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079458 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079560 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079526 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18bb62cb-8606-4626-ab13-506ff53f1088-metrics-client-ca\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079636 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-textfile\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.079760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.079708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ade602c1-00be-49db-959a-6efd1e877c9b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.080934 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.080906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ade602c1-00be-49db-959a-6efd1e877c9b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.081330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.081311 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade602c1-00be-49db-959a-6efd1e877c9b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.081407 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.081319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.089173 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.089125 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4lrw\" (UniqueName: \"kubernetes.io/projected/ade602c1-00be-49db-959a-6efd1e877c9b-kube-api-access-b4lrw\") pod \"openshift-state-metrics-65f78d5c66-9zcvg\" (UID: \"ade602c1-00be-49db-959a-6efd1e877c9b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.089245 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.089228 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69djz\" (UniqueName: \"kubernetes.io/projected/18bb62cb-8606-4626-ab13-506ff53f1088-kube-api-access-69djz\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.132555 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.132531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.173624 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.173603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" Jun 05 13:05:19.180253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f27929ce-2303-49e0-ab32-1ae3f60652b8-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.180343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.180343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27929ce-2303-49e0-ab32-1ae3f60652b8-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.180343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.180491 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7w9j\" (UniqueName: \"kubernetes.io/projected/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-api-access-h7w9j\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.180491 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.180585 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:19.180511 2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 13:05:19.180585 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:19.180567 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-tls podName:f27929ce-2303-49e0-ab32-1ae3f60652b8 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:19.68055047 +0000 UTC m=+254.372063424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-zbqbz" (UID: "f27929ce-2303-49e0-ab32-1ae3f60652b8") : secret "kube-state-metrics-tls" not found Jun 05 13:05:19.180685 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.180639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f27929ce-2303-49e0-ab32-1ae3f60652b8-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.181039 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.181016 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.181147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.181092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27929ce-2303-49e0-ab32-1ae3f60652b8-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.182559 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.182540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.195987 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.195968 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7w9j\" (UniqueName: \"kubernetes.io/projected/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-api-access-h7w9j\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.233610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.233580 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.299440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.299408 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg"] Jun 05 13:05:19.302066 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:19.302033 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade602c1_00be_49db_959a_6efd1e877c9b.slice/crio-c5179ad267a26f64547106fcaec7e6256f9acedb9ab84e864bd16a7659322726 WatchSource:0}: Error finding container c5179ad267a26f64547106fcaec7e6256f9acedb9ab84e864bd16a7659322726: Status 404 returned error can't find the container with id c5179ad267a26f64547106fcaec7e6256f9acedb9ab84e864bd16a7659322726 Jun 05 13:05:19.302538 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.302517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.461957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.461916 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.540187 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.540153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnlk6" event={"ID":"831af32a-8d08-45d3-a22f-10be956b2058","Type":"ContainerStarted","Data":"8ab178ff67daced4a536a2522de07a6c4a89df942f4625e6dfca53db9d430894"} Jun 05 13:05:19.540364 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.540210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnlk6" event={"ID":"831af32a-8d08-45d3-a22f-10be956b2058","Type":"ContainerStarted","Data":"9f45320416f45e0cd5290fbe3f230369cf9e44562ee420b47604385263de1940"} Jun 05 13:05:19.541874 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.541853 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" event={"ID":"ade602c1-00be-49db-959a-6efd1e877c9b","Type":"ContainerStarted","Data":"784e5cdec2a09a74ab421cc0548617e067e76388f12530a70a8479bf55bf9f38"} Jun 05 13:05:19.541970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.541894 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" event={"ID":"ade602c1-00be-49db-959a-6efd1e877c9b","Type":"ContainerStarted","Data":"8672ee371630910b6066ab08d7d39a3b65cf8884161b098e060764d40eab08eb"} Jun 05 13:05:19.541970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.541913 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" event={"ID":"ade602c1-00be-49db-959a-6efd1e877c9b","Type":"ContainerStarted","Data":"c5179ad267a26f64547106fcaec7e6256f9acedb9ab84e864bd16a7659322726"} Jun 05 13:05:19.554588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.554533 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gnlk6" podStartSLOduration=252.745637374 podStartE2EDuration="4m13.554520238s" totalImagesPullingTime="808.882864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:19.554348939 +0000 UTC m=+254.245861905" watchObservedRunningTime="2026-06-05 13:05:19.554520238 +0000 UTC m=+254.246033210" Jun 05 13:05:19.584790 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.584767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-tls\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.585907 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.585886 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.587147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.587129 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18bb62cb-8606-4626-ab13-506ff53f1088-node-exporter-tls\") pod \"node-exporter-p7w9l\" (UID: \"18bb62cb-8606-4626-ab13-506ff53f1088\") " pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.685386 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.685251 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.685562 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.685378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.687557 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.687539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f27929ce-2303-49e0-ab32-1ae3f60652b8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-zbqbz\" (UID: \"f27929ce-2303-49e0-ab32-1ae3f60652b8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.783696 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.783663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.805787 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.805766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p7w9l" Jun 05 13:05:19.815201 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:19.815174 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bb62cb_8606_4626_ab13_506ff53f1088.slice/crio-3c969cab0706de52573897b5fb124fb4dcb1d651f432526c1c6a4f75b7035322 WatchSource:0}: Error finding container 3c969cab0706de52573897b5fb124fb4dcb1d651f432526c1c6a4f75b7035322: Status 404 returned error can't find the container with id 3c969cab0706de52573897b5fb124fb4dcb1d651f432526c1c6a4f75b7035322 Jun 05 13:05:19.817402 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.817224 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" Jun 05 13:05:19.891642 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.891615 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:19.946777 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.946698 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz"] Jun 05 13:05:19.949742 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:19.949709 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27929ce_2303_49e0_ab32_1ae3f60652b8.slice/crio-41f96efc22ce70948ff5c11c2dce8dba2b171d2f27031b6eee312539f1198360 WatchSource:0}: Error finding container 41f96efc22ce70948ff5c11c2dce8dba2b171d2f27031b6eee312539f1198360: Status 404 returned error can't find the container with id 41f96efc22ce70948ff5c11c2dce8dba2b171d2f27031b6eee312539f1198360 Jun 05 13:05:19.961621 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:19.961593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:20.203128 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.202983 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:20.548244 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.548192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" event={"ID":"f27929ce-2303-49e0-ab32-1ae3f60652b8","Type":"ContainerStarted","Data":"41f96efc22ce70948ff5c11c2dce8dba2b171d2f27031b6eee312539f1198360"} Jun 05 13:05:20.549560 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.549529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7w9l" event={"ID":"18bb62cb-8606-4626-ab13-506ff53f1088","Type":"ContainerStarted","Data":"3c969cab0706de52573897b5fb124fb4dcb1d651f432526c1c6a4f75b7035322"} Jun 05 13:05:20.986360 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.986333 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-778798f46-gprvv"] Jun 05 13:05:20.990188 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.990172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:20.992411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.992391 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 13:05:20.992567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.992544 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 13:05:20.992664 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.992605 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 13:05:20.992812 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.992799 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b0vmgaciprdil\"" Jun 05 13:05:20.992983 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.992972 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 13:05:20.993491 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.993477 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 13:05:20.993776 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:20.993761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mnkck\"" Jun 05 13:05:21.000387 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.000368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-778798f46-gprvv"] Jun 05 13:05:21.098428 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-tls\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszdh\" (UniqueName: \"kubernetes.io/projected/d8836b12-5d6d-47dc-be14-69a2069ef146-kube-api-access-tszdh\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-grpc-tls\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8836b12-5d6d-47dc-be14-69a2069ef146-metrics-client-ca\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.098765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.098729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200076 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8836b12-5d6d-47dc-be14-69a2069ef146-metrics-client-ca\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200236 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200236 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200236 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-tls\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200539 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszdh\" (UniqueName: \"kubernetes.io/projected/d8836b12-5d6d-47dc-be14-69a2069ef146-kube-api-access-tszdh\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200901 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-grpc-tls\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.200901 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.200855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8836b12-5d6d-47dc-be14-69a2069ef146-metrics-client-ca\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.203413 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.203387 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.203506 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.203396 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.203863 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.203840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-grpc-tls\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.203952 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.203911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-tls\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.204038 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.204013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.204257 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.204233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8836b12-5d6d-47dc-be14-69a2069ef146-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.209212 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.209081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszdh\" (UniqueName: \"kubernetes.io/projected/d8836b12-5d6d-47dc-be14-69a2069ef146-kube-api-access-tszdh\") pod \"thanos-querier-778798f46-gprvv\" (UID: \"d8836b12-5d6d-47dc-be14-69a2069ef146\") " pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.326015 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.325974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:21.556319 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.556287 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" event={"ID":"ade602c1-00be-49db-959a-6efd1e877c9b","Type":"ContainerStarted","Data":"dd9bea58d57b79a9ea841237b19eadc2e654620f4348d76c54bb9e2805817d13"} Jun 05 13:05:21.558808 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.558754 2558 generic.go:356] "Generic (PLEG): container finished" podID="18bb62cb-8606-4626-ab13-506ff53f1088" containerID="281cdc7263db48d801c5c6f4ae625b7843d8344ba191b0a047225af28dcd5a84" exitCode=0 Jun 05 13:05:21.558884 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.558819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7w9l" event={"ID":"18bb62cb-8606-4626-ab13-506ff53f1088","Type":"ContainerDied","Data":"281cdc7263db48d801c5c6f4ae625b7843d8344ba191b0a047225af28dcd5a84"} Jun 05 13:05:21.574679 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.574637 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9zcvg" podStartSLOduration=2.172983035 podStartE2EDuration="3.574623103s" totalImagesPullingTime="1.401640068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:21.573550094 +0000 UTC m=+256.265063070" watchObservedRunningTime="2026-06-05 13:05:21.574623103 +0000 UTC m=+256.266136079" Jun 05 13:05:21.652327 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.652248 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-778798f46-gprvv"] Jun 05 13:05:21.654203 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:21.654176 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8836b12_5d6d_47dc_be14_69a2069ef146.slice/crio-ff7ea1988dcfd528974e2af8eea76db7760a553e52f65bac5e5381c7199bc7e6 WatchSource:0}: Error finding container ff7ea1988dcfd528974e2af8eea76db7760a553e52f65bac5e5381c7199bc7e6: Status 404 returned error can't find the container with id ff7ea1988dcfd528974e2af8eea76db7760a553e52f65bac5e5381c7199bc7e6 Jun 05 13:05:21.824748 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.824671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:21.923994 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:21.923957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:22.050963 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.050924 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:22.208692 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.208659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:22.565799 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.565665 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" event={"ID":"f27929ce-2303-49e0-ab32-1ae3f60652b8","Type":"ContainerStarted","Data":"17f64446c177b4ffceaebd6b8847fa6ea147e857236790d20b45a1cab0f5045d"} Jun 05 13:05:22.565799 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.565733 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" event={"ID":"f27929ce-2303-49e0-ab32-1ae3f60652b8","Type":"ContainerStarted","Data":"af2459df86fc5c2532f8e34a358facad9f2d86feb3124faae96e760274edf37c"} Jun 05 13:05:22.565799 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.565762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" event={"ID":"f27929ce-2303-49e0-ab32-1ae3f60652b8","Type":"ContainerStarted","Data":"b4af496a93ae7cd2522a1daaff995b8ece8b706b782cc8e8f5d6c747c6ab01d5"} Jun 05 13:05:22.566966 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.566934 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"ff7ea1988dcfd528974e2af8eea76db7760a553e52f65bac5e5381c7199bc7e6"} Jun 05 13:05:22.569158 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.569125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7w9l" event={"ID":"18bb62cb-8606-4626-ab13-506ff53f1088","Type":"ContainerStarted","Data":"6a565be60d7324e7b2d8f20854f1c48af88e7225ed7d53d5dc6b028ff4a673c2"} Jun 05 13:05:22.569267 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.569178 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7w9l" event={"ID":"18bb62cb-8606-4626-ab13-506ff53f1088","Type":"ContainerStarted","Data":"a1b46ab6ab8c645b69e676bf3ce8b4dd138e24173cb852acfd53e1f4ebc6261d"} Jun 05 13:05:22.586833 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.586785 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-zbqbz" podStartSLOduration=2.9969322739999997 podStartE2EDuration="4.586771446s" totalImagesPullingTime="1.589839172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:22.585249697 +0000 UTC m=+257.276762706" watchObservedRunningTime="2026-06-05 13:05:22.586771446 +0000 UTC m=+257.278284420" Jun 05 13:05:22.602054 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.602011 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p7w9l" podStartSLOduration=3.542427058 podStartE2EDuration="4.601990949s" totalImagesPullingTime="988.199561ms" totalInitContainerRuntime="71.36433ms" isStatefulPod=true podCreationTimestamp="2026-06-05 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:22.601817659 +0000 UTC m=+257.293330635" watchObservedRunningTime="2026-06-05 13:05:22.601990949 +0000 UTC m=+257.293503924" Jun 05 13:05:22.745313 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.745280 2558 patch_prober.go:28] interesting pod/image-registry-69f77ddd98-59z9t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:22.745482 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:22.745336 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" podUID="4824da39-6448-4844-8a8c-5efbfe658710" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:23.642855 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:23.642767 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:23.702942 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:23.702912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:24.021645 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:24.021611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:24.579218 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:24.579182 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"89b30ac5cd4275cacd85e90abae538a548e2de5204c71a3f07ed4158adc3ca0a"} Jun 05 13:05:24.579356 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:24.579248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"c06852871b67233095b96297a4ae856589fce5229d2ad18334032ee6976c34ca"} Jun 05 13:05:24.579356 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:24.579273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"792c74198f9ccbeda053872bc1577484d5120fe01255803b2ac86d15e820f890"} Jun 05 13:05:25.104264 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:25.104222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:25.585951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:25.585920 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"9405f0449f8ab987bd9c6b0ca7f4ab8d2394f8289ffb75896b4e77415fd9e35a"} Jun 05 13:05:25.586147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:25.585982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"92ce5169d8f631ec58527fba44b5d346646205ee9fced6f90b1599a64e2f6c7c"} Jun 05 13:05:25.586147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:25.586017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" event={"ID":"d8836b12-5d6d-47dc-be14-69a2069ef146","Type":"ContainerStarted","Data":"312851e6c75040a6bd1cde8363f38ca09866279ca5ffa1a62eeb3f8ed61d0bc4"} Jun 05 13:05:25.586147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:25.586064 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:25.609785 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:25.609739 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" podStartSLOduration=2.829143831 podStartE2EDuration="5.609723048s" totalImagesPullingTime="2.780579217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:25.607858718 +0000 UTC m=+260.299371687" watchObservedRunningTime="2026-06-05 13:05:25.609723048 +0000 UTC m=+260.301236026" Jun 05 13:05:27.502810 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.502770 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867f7fcdc8-xd9tl"] Jun 05 13:05:27.508529 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.508509 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.510836 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.510810 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 13:05:27.511779 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511760 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 13:05:27.511929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511897 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 13:05:27.511929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 13:05:27.512095 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511949 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wlqks\"" Jun 05 13:05:27.512095 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511903 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 13:05:27.512095 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 13:05:27.512095 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.511843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 13:05:27.514954 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.514933 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867f7fcdc8-xd9tl"] Jun 05 13:05:27.658305 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.658271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-config\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.658470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.658317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-oauth-config\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.658470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.658337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-service-ca\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.658470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.658413 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zjbn\" (UniqueName: \"kubernetes.io/projected/82981c13-aee3-43ea-a2f3-757a5f13bb99-kube-api-access-8zjbn\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.658470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.658447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-serving-cert\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.658586 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.658509 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-oauth-serving-cert\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.758957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.758875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-config\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.758957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.758927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-oauth-config\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.758957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.758946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-service-ca\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.758957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.758917 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" podUID="4824da39-6448-4844-8a8c-5efbfe658710" containerName="registry" containerID="cri-o://e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e" gracePeriod=30 Jun 05 13:05:27.759256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.758978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zjbn\" (UniqueName: \"kubernetes.io/projected/82981c13-aee3-43ea-a2f3-757a5f13bb99-kube-api-access-8zjbn\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.759256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.759012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-serving-cert\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.759256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.759062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-oauth-serving-cert\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.759753 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.759732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-oauth-serving-cert\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.759828 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.759741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-config\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.760368 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.760343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-service-ca\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.762234 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.761970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-oauth-config\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.762430 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.762406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-serving-cert\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.766836 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.766811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zjbn\" (UniqueName: \"kubernetes.io/projected/82981c13-aee3-43ea-a2f3-757a5f13bb99-kube-api-access-8zjbn\") pod \"console-867f7fcdc8-xd9tl\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.818800 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.818768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:27.950604 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.950581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867f7fcdc8-xd9tl"] Jun 05 13:05:27.952547 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:27.952514 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82981c13_aee3_43ea_a2f3_757a5f13bb99.slice/crio-c8f16a74adbfe5d5bf00141a076564e4d81d96b4a0a7ad608fb38a611b62a6b1 WatchSource:0}: Error finding container c8f16a74adbfe5d5bf00141a076564e4d81d96b4a0a7ad608fb38a611b62a6b1: Status 404 returned error can't find the container with id c8f16a74adbfe5d5bf00141a076564e4d81d96b4a0a7ad608fb38a611b62a6b1 Jun 05 13:05:27.995568 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:27.995548 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:05:28.062273 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062197 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-registry-certificates\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062273 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062243 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hd2j\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-kube-api-access-5hd2j\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062283 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-trusted-ca\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062311 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-image-registry-private-configuration\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062346 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-installation-pull-secrets\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062364 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062440 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4824da39-6448-4844-8a8c-5efbfe658710-ca-trust-extracted\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062498 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-bound-sa-token\") pod \"4824da39-6448-4844-8a8c-5efbfe658710\" (UID: \"4824da39-6448-4844-8a8c-5efbfe658710\") " Jun 05 13:05:28.062890 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062597 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:05:28.062954 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.062921 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-registry-certificates\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.063046 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.063017 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:05:28.064822 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.064795 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:05:28.064940 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.064839 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:05:28.064940 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.064903 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:05:28.064940 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.064933 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-kube-api-access-5hd2j" (OuterVolumeSpecName: "kube-api-access-5hd2j") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "kube-api-access-5hd2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:05:28.065071 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.064955 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:05:28.070676 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.070656 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4824da39-6448-4844-8a8c-5efbfe658710-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4824da39-6448-4844-8a8c-5efbfe658710" (UID: "4824da39-6448-4844-8a8c-5efbfe658710"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:05:28.164060 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164031 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hd2j\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-kube-api-access-5hd2j\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.164060 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164057 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4824da39-6448-4844-8a8c-5efbfe658710-trusted-ca\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.164060 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164068 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-image-registry-private-configuration\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.164278 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164077 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4824da39-6448-4844-8a8c-5efbfe658710-installation-pull-secrets\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.164278 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164086 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-registry-tls\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.164278 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164094 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4824da39-6448-4844-8a8c-5efbfe658710-ca-trust-extracted\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.164278 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.164114 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4824da39-6448-4844-8a8c-5efbfe658710-bound-sa-token\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:05:28.598408 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.598377 2558 generic.go:356] "Generic (PLEG): container finished" podID="4824da39-6448-4844-8a8c-5efbfe658710" containerID="e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e" exitCode=0 Jun 05 13:05:28.598883 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.598426 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" Jun 05 13:05:28.598883 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.598471 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" event={"ID":"4824da39-6448-4844-8a8c-5efbfe658710","Type":"ContainerDied","Data":"e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e"} Jun 05 13:05:28.598883 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.598522 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f77ddd98-59z9t" event={"ID":"4824da39-6448-4844-8a8c-5efbfe658710","Type":"ContainerDied","Data":"c44211b28396fe952453129aeb59fd4a1eac663b7be5c3851ecbb86b07874e24"} Jun 05 13:05:28.598883 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.598552 2558 scope.go:117] "RemoveContainer" containerID="e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e" Jun 05 13:05:28.600260 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.600234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867f7fcdc8-xd9tl" event={"ID":"82981c13-aee3-43ea-a2f3-757a5f13bb99","Type":"ContainerStarted","Data":"c8f16a74adbfe5d5bf00141a076564e4d81d96b4a0a7ad608fb38a611b62a6b1"} Jun 05 13:05:28.608826 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.608743 2558 scope.go:117] "RemoveContainer" containerID="e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e" Jun 05 13:05:28.609069 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:28.609042 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e\": container with ID starting with e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e not found: ID does not exist" containerID="e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e" Jun 05 13:05:28.609188 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.609074 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e"} err="failed to get container status \"e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e\": rpc error: code = NotFound desc = could not find container \"e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e\": container with ID starting with e163e54e9abdde2cf0218bee98941ea116c0b7158635eb4ad9ba01035c18803e not found: ID does not exist" Jun 05 13:05:28.621033 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.621008 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69f77ddd98-59z9t"] Jun 05 13:05:28.623567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:28.623543 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69f77ddd98-59z9t"] Jun 05 13:05:29.765343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:29.765306 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4824da39-6448-4844-8a8c-5efbfe658710" path="/var/lib/kubelet/pods/4824da39-6448-4844-8a8c-5efbfe658710/volumes" Jun 05 13:05:31.596276 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:31.596244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-778798f46-gprvv" Jun 05 13:05:31.726241 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:31.726208 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:32.617831 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:32.617795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867f7fcdc8-xd9tl" event={"ID":"82981c13-aee3-43ea-a2f3-757a5f13bb99","Type":"ContainerStarted","Data":"fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4"} Jun 05 13:05:32.636472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:32.636423 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867f7fcdc8-xd9tl" podStartSLOduration=1.8576514610000001 podStartE2EDuration="5.636408024s" totalImagesPullingTime="3.778756563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:32.635255475 +0000 UTC m=+267.326768454" watchObservedRunningTime="2026-06-05 13:05:32.636408024 +0000 UTC m=+267.327920998" Jun 05 13:05:32.791815 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:32.791784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:36.097270 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.097236 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7d4b6c6d-b8chc"] Jun 05 13:05:36.097627 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.097558 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4824da39-6448-4844-8a8c-5efbfe658710" containerName="registry" Jun 05 13:05:36.097627 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.097569 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4824da39-6448-4844-8a8c-5efbfe658710" containerName="registry" Jun 05 13:05:36.097627 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.097616 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4824da39-6448-4844-8a8c-5efbfe658710" containerName="registry" Jun 05 13:05:36.101489 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.101472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.108976 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.108953 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 13:05:36.109493 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.109471 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7d4b6c6d-b8chc"] Jun 05 13:05:36.132798 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.132771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-oauth-serving-cert\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.132921 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.132828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-console-config\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.132921 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.132882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-serving-cert\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.133031 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.132964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkjd\" (UniqueName: \"kubernetes.io/projected/c59d2929-2746-4e02-b4eb-d411393009aa-kube-api-access-mrkjd\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.133031 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.133019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-trusted-ca-bundle\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.133164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.133052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-service-ca\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.133164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.133129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-oauth-config\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233536 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkjd\" (UniqueName: \"kubernetes.io/projected/c59d2929-2746-4e02-b4eb-d411393009aa-kube-api-access-mrkjd\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-trusted-ca-bundle\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-service-ca\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-oauth-config\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-oauth-serving-cert\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233880 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-console-config\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.233880 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.233726 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-serving-cert\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.234473 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.234441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-service-ca\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.234582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.234472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-oauth-serving-cert\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.234582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.234485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-console-config\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.234737 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.234714 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-trusted-ca-bundle\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.236166 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.236141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-oauth-config\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.236262 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.236236 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-serving-cert\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.241755 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.241733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkjd\" (UniqueName: \"kubernetes.io/projected/c59d2929-2746-4e02-b4eb-d411393009aa-kube-api-access-mrkjd\") pod \"console-5f7d4b6c6d-b8chc\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.287587 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.287560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:36.339759 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.339738 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:36.412140 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.412060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:36.535058 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.535036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7d4b6c6d-b8chc"] Jun 05 13:05:36.537448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:36.537423 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59d2929_2746_4e02_b4eb_d411393009aa.slice/crio-741bcfef338a7f35611b4c83ca5a9bd4cf6953f2fdb651c41ee88f212de97f10 WatchSource:0}: Error finding container 741bcfef338a7f35611b4c83ca5a9bd4cf6953f2fdb651c41ee88f212de97f10: Status 404 returned error can't find the container with id 741bcfef338a7f35611b4c83ca5a9bd4cf6953f2fdb651c41ee88f212de97f10 Jun 05 13:05:36.634570 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.634540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7d4b6c6d-b8chc" event={"ID":"c59d2929-2746-4e02-b4eb-d411393009aa","Type":"ContainerStarted","Data":"e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e"} Jun 05 13:05:36.634697 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.634590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7d4b6c6d-b8chc" event={"ID":"c59d2929-2746-4e02-b4eb-d411393009aa","Type":"ContainerStarted","Data":"741bcfef338a7f35611b4c83ca5a9bd4cf6953f2fdb651c41ee88f212de97f10"} Jun 05 13:05:36.650667 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:36.650623 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7d4b6c6d-b8chc" podStartSLOduration=0.650606017 podStartE2EDuration="650.606017ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:36.649879519 +0000 UTC m=+271.341392495" watchObservedRunningTime="2026-06-05 13:05:36.650606017 +0000 UTC m=+271.342118993" Jun 05 13:05:37.819416 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:37.819386 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:37.819795 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:37.819438 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:05:37.820519 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:37.820499 2558 patch_prober.go:28] interesting pod/console-867f7fcdc8-xd9tl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 05 13:05:37.820563 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:37.820540 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-867f7fcdc8-xd9tl" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 05 13:05:38.113846 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:38.113771 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:38.163389 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:38.163363 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:45.302266 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:45.302233 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:46.244049 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:05:46.243985 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9qxkm" podUID="6a00ab16-fe20-4cdf-8de9-c7405990f067" Jun 05 13:05:46.413133 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.413069 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:46.413548 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.413155 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:05:46.414723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.414697 2558 patch_prober.go:28] interesting pod/console-5f7d4b6c6d-b8chc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 05 13:05:46.414823 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.414742 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f7d4b6c6d-b8chc" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 05 13:05:46.543736 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.543663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:46.600971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.600940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:46.669988 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:46.669965 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9qxkm" Jun 05 13:05:47.819913 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:47.819879 2558 patch_prober.go:28] interesting pod/console-867f7fcdc8-xd9tl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 05 13:05:47.820316 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:47.819932 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-867f7fcdc8-xd9tl" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 05 13:05:50.044604 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:50.044561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:05:50.046772 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:50.046751 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a00ab16-fe20-4cdf-8de9-c7405990f067-metrics-tls\") pod \"dns-default-9qxkm\" (UID: \"6a00ab16-fe20-4cdf-8de9-c7405990f067\") " pod="openshift-dns/dns-default-9qxkm" Jun 05 13:05:50.272969 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:50.272937 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ncksb\"" Jun 05 13:05:50.281432 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:50.281412 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9qxkm" Jun 05 13:05:50.412527 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:50.412491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9qxkm"] Jun 05 13:05:50.418541 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:05:50.418508 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a00ab16_fe20_4cdf_8de9_c7405990f067.slice/crio-93eb6a5ff52a05940aa9638784e560f0e9ce62f6d5449c37ddcd634620768bb3 WatchSource:0}: Error finding container 93eb6a5ff52a05940aa9638784e560f0e9ce62f6d5449c37ddcd634620768bb3: Status 404 returned error can't find the container with id 93eb6a5ff52a05940aa9638784e560f0e9ce62f6d5449c37ddcd634620768bb3 Jun 05 13:05:50.686973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:50.686893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9qxkm" event={"ID":"6a00ab16-fe20-4cdf-8de9-c7405990f067","Type":"ContainerStarted","Data":"93eb6a5ff52a05940aa9638784e560f0e9ce62f6d5449c37ddcd634620768bb3"} Jun 05 13:05:52.697175 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:52.697136 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9qxkm" event={"ID":"6a00ab16-fe20-4cdf-8de9-c7405990f067","Type":"ContainerStarted","Data":"1e6059e86a10d6cd128a8bc7882002bbf5008f35a288bc9d11a0d1e208e10568"} Jun 05 13:05:52.697557 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:52.697190 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9qxkm" event={"ID":"6a00ab16-fe20-4cdf-8de9-c7405990f067","Type":"ContainerStarted","Data":"8e597003fcc3c776010837e6535e3d782e7f59706de89fa2ca71e891453b7440"} Jun 05 13:05:52.697557 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:52.697257 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9qxkm" Jun 05 13:05:52.714807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:52.714763 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9qxkm" podStartSLOduration=251.340759795 podStartE2EDuration="4m12.714748271s" totalImagesPullingTime="1.373988476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:52.713392181 +0000 UTC m=+287.404905161" watchObservedRunningTime="2026-06-05 13:05:52.714748271 +0000 UTC m=+287.406261245" Jun 05 13:05:55.298397 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:55.298363 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:55.358807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:55.358780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:56.412506 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:56.412463 2558 patch_prober.go:28] interesting pod/console-5f7d4b6c6d-b8chc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 05 13:05:56.412861 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:56.412516 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f7d4b6c6d-b8chc" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 05 13:05:57.705409 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:57.705377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:57.804542 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:57.804514 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:05:57.819805 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:57.819782 2558 patch_prober.go:28] interesting pod/console-867f7fcdc8-xd9tl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 05 13:05:57.819887 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:57.819827 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-867f7fcdc8-xd9tl" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 05 13:05:58.719440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:58.719407 2558 generic.go:356] "Generic (PLEG): container finished" podID="1c76abce-52fc-490e-a23e-c08c4509f1b9" containerID="f3c1af38bbf4390639a7e16e34d493b8e31a3dabbe57fb661fe09b40f3ec6198" exitCode=0 Jun 05 13:05:58.719810 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:58.719481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5t2lj" event={"ID":"1c76abce-52fc-490e-a23e-c08c4509f1b9","Type":"ContainerDied","Data":"f3c1af38bbf4390639a7e16e34d493b8e31a3dabbe57fb661fe09b40f3ec6198"} Jun 05 13:05:58.719810 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:58.719786 2558 scope.go:117] "RemoveContainer" containerID="f3c1af38bbf4390639a7e16e34d493b8e31a3dabbe57fb661fe09b40f3ec6198" Jun 05 13:05:59.725252 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:05:59.725217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5t2lj" event={"ID":"1c76abce-52fc-490e-a23e-c08c4509f1b9","Type":"ContainerStarted","Data":"e3df32501a07cce67b85aace30f2645467ac0b7a24842fe1d35e9b4c1533cdb6"} Jun 05 13:06:01.734553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:01.734520 2558 generic.go:356] "Generic (PLEG): container finished" podID="58c87b6c-38c9-4b38-bb27-76ae588c01c6" containerID="59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782" exitCode=1 Jun 05 13:06:01.734944 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:01.734591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" event={"ID":"58c87b6c-38c9-4b38-bb27-76ae588c01c6","Type":"ContainerDied","Data":"59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782"} Jun 05 13:06:01.734944 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:01.734650 2558 scope.go:117] "RemoveContainer" containerID="f29c999a4a7d7565b0b517bb128691a437383784ce56f4528d31aff3320c4b9a" Jun 05 13:06:01.734944 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:01.734940 2558 scope.go:117] "RemoveContainer" containerID="59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782" Jun 05 13:06:01.735190 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:06:01.735168 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-f99b7cc99-qhbr9_open-cluster-management-agent-addon(58c87b6c-38c9-4b38-bb27-76ae588c01c6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" podUID="58c87b6c-38c9-4b38-bb27-76ae588c01c6" Jun 05 13:06:02.290576 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:02.290547 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:06:02.702874 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:02.702801 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9qxkm" Jun 05 13:06:02.740980 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:02.740946 2558 scope.go:117] "RemoveContainer" containerID="59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782" Jun 05 13:06:02.741352 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:06:02.741140 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-f99b7cc99-qhbr9_open-cluster-management-agent-addon(58c87b6c-38c9-4b38-bb27-76ae588c01c6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" podUID="58c87b6c-38c9-4b38-bb27-76ae588c01c6" Jun 05 13:06:04.933740 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:04.933707 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:05.007024 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.006991 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:05.122292 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.122258 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:05.222570 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.222537 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:05.284488 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.284461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:05.721118 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.721075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:06:05.721232 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.721203 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:06:05.724748 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:05.724729 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 13:06:06.416751 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.416722 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:06:06.420556 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.420533 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:06:06.502569 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.502536 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867f7fcdc8-xd9tl"] Jun 05 13:06:06.621457 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.621416 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:06:06.621823 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.621806 2558 scope.go:117] "RemoveContainer" containerID="59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782" Jun 05 13:06:06.622025 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:06:06.621995 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-f99b7cc99-qhbr9_open-cluster-management-agent-addon(58c87b6c-38c9-4b38-bb27-76ae588c01c6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" podUID="58c87b6c-38c9-4b38-bb27-76ae588c01c6" Jun 05 13:06:06.627285 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.627261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:06.726716 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.726685 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:06.784434 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:06.784405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:07.098793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:07.098714 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:07.161140 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:07.161094 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:07.286449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:07.286419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:07.357043 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:07.356967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:08.081147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:08.081116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:08.139791 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:08.139763 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:15.899288 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:15.899253 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:15.958739 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:15.958704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:17.159014 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:17.158987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:17.263002 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:17.262967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:20.758550 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:20.758521 2558 scope.go:117] "RemoveContainer" containerID="59d3ba06a221260a07de370ea911334d14fd9b594db833a3a571eca4046f5782" Jun 05 13:06:21.824462 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:21.824426 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" event={"ID":"58c87b6c-38c9-4b38-bb27-76ae588c01c6","Type":"ContainerStarted","Data":"dd6d50c8490691745893dedb131a000ab40dc3bf855add653506664e6dc91d58"} Jun 05 13:06:21.824886 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:21.824705 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:06:21.826350 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:21.826332 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f99b7cc99-qhbr9" Jun 05 13:06:25.014002 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:25.013971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:25.112486 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:25.112454 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:27.734317 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:27.734281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:27.833047 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:27.833007 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:30.532709 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:30.532677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:30.632831 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:30.632798 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:31.522373 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.522335 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-867f7fcdc8-xd9tl" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" containerID="cri-o://fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4" gracePeriod=15 Jun 05 13:06:31.758727 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.758704 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:06:31.789240 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789179 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-service-ca\") pod \"82981c13-aee3-43ea-a2f3-757a5f13bb99\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " Jun 05 13:06:31.789374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789245 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-oauth-serving-cert\") pod \"82981c13-aee3-43ea-a2f3-757a5f13bb99\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " Jun 05 13:06:31.789374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789291 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zjbn\" (UniqueName: \"kubernetes.io/projected/82981c13-aee3-43ea-a2f3-757a5f13bb99-kube-api-access-8zjbn\") pod \"82981c13-aee3-43ea-a2f3-757a5f13bb99\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " Jun 05 13:06:31.789374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789311 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-serving-cert\") pod \"82981c13-aee3-43ea-a2f3-757a5f13bb99\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " Jun 05 13:06:31.789374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789329 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-config\") pod \"82981c13-aee3-43ea-a2f3-757a5f13bb99\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " Jun 05 13:06:31.789374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789346 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-oauth-config\") pod \"82981c13-aee3-43ea-a2f3-757a5f13bb99\" (UID: \"82981c13-aee3-43ea-a2f3-757a5f13bb99\") " Jun 05 13:06:31.789698 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789669 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-service-ca" (OuterVolumeSpecName: "service-ca") pod "82981c13-aee3-43ea-a2f3-757a5f13bb99" (UID: "82981c13-aee3-43ea-a2f3-757a5f13bb99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:06:31.789777 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789721 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82981c13-aee3-43ea-a2f3-757a5f13bb99" (UID: "82981c13-aee3-43ea-a2f3-757a5f13bb99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:06:31.789829 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.789765 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-config" (OuterVolumeSpecName: "console-config") pod "82981c13-aee3-43ea-a2f3-757a5f13bb99" (UID: "82981c13-aee3-43ea-a2f3-757a5f13bb99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:06:31.791638 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.791614 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82981c13-aee3-43ea-a2f3-757a5f13bb99-kube-api-access-8zjbn" (OuterVolumeSpecName: "kube-api-access-8zjbn") pod "82981c13-aee3-43ea-a2f3-757a5f13bb99" (UID: "82981c13-aee3-43ea-a2f3-757a5f13bb99"). InnerVolumeSpecName "kube-api-access-8zjbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:06:31.791759 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.791700 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82981c13-aee3-43ea-a2f3-757a5f13bb99" (UID: "82981c13-aee3-43ea-a2f3-757a5f13bb99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:06:31.791759 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.791715 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82981c13-aee3-43ea-a2f3-757a5f13bb99" (UID: "82981c13-aee3-43ea-a2f3-757a5f13bb99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:06:31.860729 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.860695 2558 generic.go:356] "Generic (PLEG): container finished" podID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerID="fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4" exitCode=0 Jun 05 13:06:31.860833 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.860733 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867f7fcdc8-xd9tl" Jun 05 13:06:31.860833 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.860783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867f7fcdc8-xd9tl" event={"ID":"82981c13-aee3-43ea-a2f3-757a5f13bb99","Type":"ContainerDied","Data":"fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4"} Jun 05 13:06:31.860905 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.860834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867f7fcdc8-xd9tl" event={"ID":"82981c13-aee3-43ea-a2f3-757a5f13bb99","Type":"ContainerDied","Data":"c8f16a74adbfe5d5bf00141a076564e4d81d96b4a0a7ad608fb38a611b62a6b1"} Jun 05 13:06:31.860905 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.860854 2558 scope.go:117] "RemoveContainer" containerID="fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4" Jun 05 13:06:31.870830 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.870811 2558 scope.go:117] "RemoveContainer" containerID="fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4" Jun 05 13:06:31.871191 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:06:31.871161 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4\": container with ID starting with fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4 not found: ID does not exist" containerID="fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4" Jun 05 13:06:31.871352 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.871198 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4"} err="failed to get container status \"fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4\": rpc error: code = NotFound desc = could not find container \"fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4\": container with ID starting with fdef7afcc34eeba849144c9c451935cdad3f82f99479076b8a079ad5aa4ab7b4 not found: ID does not exist" Jun 05 13:06:31.881048 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.881029 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867f7fcdc8-xd9tl"] Jun 05 13:06:31.885574 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.885555 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-867f7fcdc8-xd9tl"] Jun 05 13:06:31.890160 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.890144 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-oauth-serving-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:06:31.890224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.890162 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zjbn\" (UniqueName: \"kubernetes.io/projected/82981c13-aee3-43ea-a2f3-757a5f13bb99-kube-api-access-8zjbn\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:06:31.890224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.890173 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-serving-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:06:31.890224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.890185 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:06:31.890224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.890198 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82981c13-aee3-43ea-a2f3-757a5f13bb99-console-oauth-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:06:31.890224 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:31.890206 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82981c13-aee3-43ea-a2f3-757a5f13bb99-service-ca\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:06:33.763642 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:33.763610 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" path="/var/lib/kubelet/pods/82981c13-aee3-43ea-a2f3-757a5f13bb99/volumes" Jun 05 13:06:34.994836 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:34.994803 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:35.059369 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:35.059341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:42.711002 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:42.710966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:42.775349 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:42.775318 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:50.469460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:50.469424 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:50.541167 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:50.541134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:57.714214 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:57.714134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:06:57.814897 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:06:57.814869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:09.275045 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.275005 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8468786547-g7stf"] Jun 05 13:07:09.275723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.275479 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" Jun 05 13:07:09.275723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.275501 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" Jun 05 13:07:09.275723 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.275617 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="82981c13-aee3-43ea-a2f3-757a5f13bb99" containerName="console" Jun 05 13:07:09.279941 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.279920 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.293688 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.293667 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468786547-g7stf"] Jun 05 13:07:09.348241 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.348214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:09.363085 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-service-ca\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.363178 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27c8c\" (UniqueName: \"kubernetes.io/projected/bacbe249-75be-464e-849a-a822c62cf387-kube-api-access-27c8c\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.363218 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-console-config\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.363256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-trusted-ca-bundle\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.363290 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-serving-cert\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.363290 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-oauth-serving-cert\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.363352 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.363311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-oauth-config\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.450290 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.450263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:09.464407 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-oauth-config\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.464476 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-service-ca\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.464476 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27c8c\" (UniqueName: \"kubernetes.io/projected/bacbe249-75be-464e-849a-a822c62cf387-kube-api-access-27c8c\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.464548 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-console-config\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.464548 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-trusted-ca-bundle\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.464548 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-serving-cert\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.464698 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.464554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-oauth-serving-cert\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.465164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.465141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-service-ca\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.465334 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.465310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-oauth-serving-cert\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.465412 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.465377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-trusted-ca-bundle\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.465470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.465428 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-console-config\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.467353 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.467338 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-oauth-config\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.467554 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.467535 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-serving-cert\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.473332 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.473296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27c8c\" (UniqueName: \"kubernetes.io/projected/bacbe249-75be-464e-849a-a822c62cf387-kube-api-access-27c8c\") pod \"console-8468786547-g7stf\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.589468 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.589382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:09.718549 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:09.718438 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468786547-g7stf"] Jun 05 13:07:09.721157 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:07:09.721122 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacbe249_75be_464e_849a_a822c62cf387.slice/crio-265cdba87c9817c6f9b4908d9bb731e3832c20cf79fb7bccd17ee54afc2f3c9d WatchSource:0}: Error finding container 265cdba87c9817c6f9b4908d9bb731e3832c20cf79fb7bccd17ee54afc2f3c9d: Status 404 returned error can't find the container with id 265cdba87c9817c6f9b4908d9bb731e3832c20cf79fb7bccd17ee54afc2f3c9d Jun 05 13:07:10.000404 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:10.000371 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468786547-g7stf" event={"ID":"bacbe249-75be-464e-849a-a822c62cf387","Type":"ContainerStarted","Data":"9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e"} Jun 05 13:07:10.000588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:10.000455 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468786547-g7stf" event={"ID":"bacbe249-75be-464e-849a-a822c62cf387","Type":"ContainerStarted","Data":"265cdba87c9817c6f9b4908d9bb731e3832c20cf79fb7bccd17ee54afc2f3c9d"} Jun 05 13:07:10.020771 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:10.020719 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8468786547-g7stf" podStartSLOduration=1.020703591 podStartE2EDuration="1.020703591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:10.019422387 +0000 UTC m=+364.710935372" watchObservedRunningTime="2026-06-05 13:07:10.020703591 +0000 UTC m=+364.712216624" Jun 05 13:07:19.590267 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:19.590229 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:19.590726 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:19.590292 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:19.595068 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:19.595044 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:20.041002 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:20.040976 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:07:20.085286 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:20.085255 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7d4b6c6d-b8chc"] Jun 05 13:07:20.211090 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:20.211053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:20.308460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:20.308379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:20.368310 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:20.368280 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:45.105885 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.105820 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f7d4b6c6d-b8chc" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" containerName="console" containerID="cri-o://e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e" gracePeriod=15 Jun 05 13:07:45.351337 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.351313 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:07:45.435242 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435176 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-trusted-ca-bundle\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435242 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435208 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-console-config\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435242 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435233 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-oauth-config\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435255 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-serving-cert\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435270 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-service-ca\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435307 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-oauth-serving-cert\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435382 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrkjd\" (UniqueName: \"kubernetes.io/projected/c59d2929-2746-4e02-b4eb-d411393009aa-kube-api-access-mrkjd\") pod \"c59d2929-2746-4e02-b4eb-d411393009aa\" (UID: \"c59d2929-2746-4e02-b4eb-d411393009aa\") " Jun 05 13:07:45.435763 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435734 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:07:45.435837 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435759 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:07:45.435837 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435739 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-console-config" (OuterVolumeSpecName: "console-config") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:07:45.435837 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.435765 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:07:45.437471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.437451 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59d2929-2746-4e02-b4eb-d411393009aa-kube-api-access-mrkjd" (OuterVolumeSpecName: "kube-api-access-mrkjd") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "kube-api-access-mrkjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:07:45.437832 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.437809 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:07:45.437897 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.437823 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c59d2929-2746-4e02-b4eb-d411393009aa" (UID: "c59d2929-2746-4e02-b4eb-d411393009aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:07:45.536455 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536428 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-oauth-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:45.536567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536458 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c59d2929-2746-4e02-b4eb-d411393009aa-console-serving-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:45.536567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536472 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-service-ca\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:45.536567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536486 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-oauth-serving-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:45.536567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536499 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrkjd\" (UniqueName: \"kubernetes.io/projected/c59d2929-2746-4e02-b4eb-d411393009aa-kube-api-access-mrkjd\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:45.536567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536512 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-trusted-ca-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:45.536567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:45.536524 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c59d2929-2746-4e02-b4eb-d411393009aa-console-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:07:46.133129 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.133025 2558 generic.go:356] "Generic (PLEG): container finished" podID="c59d2929-2746-4e02-b4eb-d411393009aa" containerID="e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e" exitCode=0 Jun 05 13:07:46.133129 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.133067 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7d4b6c6d-b8chc" Jun 05 13:07:46.133596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.133132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7d4b6c6d-b8chc" event={"ID":"c59d2929-2746-4e02-b4eb-d411393009aa","Type":"ContainerDied","Data":"e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e"} Jun 05 13:07:46.133596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.133181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7d4b6c6d-b8chc" event={"ID":"c59d2929-2746-4e02-b4eb-d411393009aa","Type":"ContainerDied","Data":"741bcfef338a7f35611b4c83ca5a9bd4cf6953f2fdb651c41ee88f212de97f10"} Jun 05 13:07:46.133596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.133202 2558 scope.go:117] "RemoveContainer" containerID="e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e" Jun 05 13:07:46.141005 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.140972 2558 scope.go:117] "RemoveContainer" containerID="e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e" Jun 05 13:07:46.141246 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:07:46.141225 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e\": container with ID starting with e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e not found: ID does not exist" containerID="e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e" Jun 05 13:07:46.141360 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.141253 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e"} err="failed to get container status \"e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e\": rpc error: code = NotFound desc = could not find container \"e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e\": container with ID starting with e61f57a048178e5024de44915f45378fdf57a534d2bdccb3842e29947190d18e not found: ID does not exist" Jun 05 13:07:46.151828 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.151805 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7d4b6c6d-b8chc"] Jun 05 13:07:46.156472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:46.156451 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7d4b6c6d-b8chc"] Jun 05 13:07:47.763624 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:47.763593 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" path="/var/lib/kubelet/pods/c59d2929-2746-4e02-b4eb-d411393009aa/volumes" Jun 05 13:07:52.476467 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:52.476434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:58.059476 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:58.059422 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:07:58.126341 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:07:58.126310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:08:44.671823 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:44.671790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:08:44.770605 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:44.770570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:08:45.571058 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.571029 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz"] Jun 05 13:08:45.571354 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.571341 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" containerName="console" Jun 05 13:08:45.571403 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.571356 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" containerName="console" Jun 05 13:08:45.571437 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.571421 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c59d2929-2746-4e02-b4eb-d411393009aa" containerName="console" Jun 05 13:08:45.574367 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.574351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.576867 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.576843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:08:45.577044 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.577025 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:08:45.577825 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.577806 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zppkr\"" Jun 05 13:08:45.589273 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.589249 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz"] Jun 05 13:08:45.688326 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.688291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkcrl\" (UniqueName: \"kubernetes.io/projected/d4c39a96-5ace-4605-9eb7-db04301d4db3-kube-api-access-pkcrl\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.688710 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.688358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.688710 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.688418 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.788887 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.788853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkcrl\" (UniqueName: \"kubernetes.io/projected/d4c39a96-5ace-4605-9eb7-db04301d4db3-kube-api-access-pkcrl\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.789047 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.788917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.789047 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.788973 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.789291 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.789270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.789364 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.789320 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.797583 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.797561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkcrl\" (UniqueName: \"kubernetes.io/projected/d4c39a96-5ace-4605-9eb7-db04301d4db3-kube-api-access-pkcrl\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:45.883455 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:45.883399 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:08:46.011578 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:46.011551 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz"] Jun 05 13:08:46.014279 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:08:46.014248 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c39a96_5ace_4605_9eb7_db04301d4db3.slice/crio-88dd19567cb87d3588e947c23cffcb3e7179d71802f66aacfe063bea45aedd2e WatchSource:0}: Error finding container 88dd19567cb87d3588e947c23cffcb3e7179d71802f66aacfe063bea45aedd2e: Status 404 returned error can't find the container with id 88dd19567cb87d3588e947c23cffcb3e7179d71802f66aacfe063bea45aedd2e Jun 05 13:08:46.016272 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:46.016253 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:08:46.354853 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:46.354817 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" event={"ID":"d4c39a96-5ace-4605-9eb7-db04301d4db3","Type":"ContainerStarted","Data":"88dd19567cb87d3588e947c23cffcb3e7179d71802f66aacfe063bea45aedd2e"} Jun 05 13:08:53.808293 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:53.808218 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:08:55.392725 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:55.392693 2558 generic.go:356] "Generic (PLEG): container finished" podID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerID="5dc9a036f5dac4ab769880cd49a3df57ff2abbecb500ddfea4d6b293b82c5a6f" exitCode=0 Jun 05 13:08:55.393220 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:55.392743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" event={"ID":"d4c39a96-5ace-4605-9eb7-db04301d4db3","Type":"ContainerDied","Data":"5dc9a036f5dac4ab769880cd49a3df57ff2abbecb500ddfea4d6b293b82c5a6f"} Jun 05 13:08:57.402363 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:57.402320 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" event={"ID":"d4c39a96-5ace-4605-9eb7-db04301d4db3","Type":"ContainerStarted","Data":"39454917bb2d7202233248a9f1f7074383c3141dfe53744230b833322de117c3"} Jun 05 13:08:58.407580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:58.407542 2558 generic.go:356] "Generic (PLEG): container finished" podID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerID="39454917bb2d7202233248a9f1f7074383c3141dfe53744230b833322de117c3" exitCode=0 Jun 05 13:08:58.407959 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:08:58.407616 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" event={"ID":"d4c39a96-5ace-4605-9eb7-db04301d4db3","Type":"ContainerDied","Data":"39454917bb2d7202233248a9f1f7074383c3141dfe53744230b833322de117c3"} Jun 05 13:09:06.441804 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:06.441772 2558 generic.go:356] "Generic (PLEG): container finished" podID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerID="f65efa7e720b120b04f6fdcbe1dfbba0fac944c49d55d6e3946751070f9e44c2" exitCode=0 Jun 05 13:09:06.442213 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:06.441850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" event={"ID":"d4c39a96-5ace-4605-9eb7-db04301d4db3","Type":"ContainerDied","Data":"f65efa7e720b120b04f6fdcbe1dfbba0fac944c49d55d6e3946751070f9e44c2"} Jun 05 13:09:07.610592 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.610566 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:09:07.650147 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.650119 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkcrl\" (UniqueName: \"kubernetes.io/projected/d4c39a96-5ace-4605-9eb7-db04301d4db3-kube-api-access-pkcrl\") pod \"d4c39a96-5ace-4605-9eb7-db04301d4db3\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " Jun 05 13:09:07.650284 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.650158 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-bundle\") pod \"d4c39a96-5ace-4605-9eb7-db04301d4db3\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " Jun 05 13:09:07.650284 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.650186 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-util\") pod \"d4c39a96-5ace-4605-9eb7-db04301d4db3\" (UID: \"d4c39a96-5ace-4605-9eb7-db04301d4db3\") " Jun 05 13:09:07.650774 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.650752 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-bundle" (OuterVolumeSpecName: "bundle") pod "d4c39a96-5ace-4605-9eb7-db04301d4db3" (UID: "d4c39a96-5ace-4605-9eb7-db04301d4db3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:09:07.652297 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.652275 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c39a96-5ace-4605-9eb7-db04301d4db3-kube-api-access-pkcrl" (OuterVolumeSpecName: "kube-api-access-pkcrl") pod "d4c39a96-5ace-4605-9eb7-db04301d4db3" (UID: "d4c39a96-5ace-4605-9eb7-db04301d4db3"). InnerVolumeSpecName "kube-api-access-pkcrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:09:07.654863 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.654835 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-util" (OuterVolumeSpecName: "util") pod "d4c39a96-5ace-4605-9eb7-db04301d4db3" (UID: "d4c39a96-5ace-4605-9eb7-db04301d4db3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:09:07.751538 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.751508 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkcrl\" (UniqueName: \"kubernetes.io/projected/d4c39a96-5ace-4605-9eb7-db04301d4db3-kube-api-access-pkcrl\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:07.751538 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.751538 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:07.751678 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:07.751551 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c39a96-5ace-4605-9eb7-db04301d4db3-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:08.450752 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:08.450717 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" event={"ID":"d4c39a96-5ace-4605-9eb7-db04301d4db3","Type":"ContainerDied","Data":"88dd19567cb87d3588e947c23cffcb3e7179d71802f66aacfe063bea45aedd2e"} Jun 05 13:09:08.450937 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:08.450766 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dk4zfz" Jun 05 13:09:08.450937 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:08.450772 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88dd19567cb87d3588e947c23cffcb3e7179d71802f66aacfe063bea45aedd2e" Jun 05 13:09:11.860859 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:11.860805 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:12.308279 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:12.308239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:14.122368 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122331 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x"] Jun 05 13:09:14.122844 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122766 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="util" Jun 05 13:09:14.122844 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122784 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="util" Jun 05 13:09:14.122844 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122802 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="extract" Jun 05 13:09:14.122844 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122810 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="extract" Jun 05 13:09:14.122844 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122825 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="pull" Jun 05 13:09:14.122844 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122832 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="pull" Jun 05 13:09:14.123175 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.122914 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c39a96-5ace-4605-9eb7-db04301d4db3" containerName="extract" Jun 05 13:09:14.125273 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.125252 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.129876 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.129845 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:09:14.129976 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.129851 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 13:09:14.130049 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.130022 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dk49h\"" Jun 05 13:09:14.152655 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.152629 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x"] Jun 05 13:09:14.200440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.200408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jwg\" (UniqueName: \"kubernetes.io/projected/09a150f4-ce59-4a5f-ad76-827136483007-kube-api-access-h9jwg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lcq9x\" (UID: \"09a150f4-ce59-4a5f-ad76-827136483007\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.200590 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.200453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a150f4-ce59-4a5f-ad76-827136483007-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lcq9x\" (UID: \"09a150f4-ce59-4a5f-ad76-827136483007\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.301704 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.301662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a150f4-ce59-4a5f-ad76-827136483007-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lcq9x\" (UID: \"09a150f4-ce59-4a5f-ad76-827136483007\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.301832 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.301760 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jwg\" (UniqueName: \"kubernetes.io/projected/09a150f4-ce59-4a5f-ad76-827136483007-kube-api-access-h9jwg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lcq9x\" (UID: \"09a150f4-ce59-4a5f-ad76-827136483007\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.302155 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.302137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a150f4-ce59-4a5f-ad76-827136483007-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lcq9x\" (UID: \"09a150f4-ce59-4a5f-ad76-827136483007\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.315211 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.315188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jwg\" (UniqueName: \"kubernetes.io/projected/09a150f4-ce59-4a5f-ad76-827136483007-kube-api-access-h9jwg\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lcq9x\" (UID: \"09a150f4-ce59-4a5f-ad76-827136483007\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.434477 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.434398 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" Jun 05 13:09:14.573375 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:14.573350 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x"] Jun 05 13:09:14.575720 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:09:14.575697 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a150f4_ce59_4a5f_ad76_827136483007.slice/crio-7c250d36837548d5b4351d6697f8680a5f1f859d625c25d765a4bc9e16387816 WatchSource:0}: Error finding container 7c250d36837548d5b4351d6697f8680a5f1f859d625c25d765a4bc9e16387816: Status 404 returned error can't find the container with id 7c250d36837548d5b4351d6697f8680a5f1f859d625c25d765a4bc9e16387816 Jun 05 13:09:15.478813 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:15.478780 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" event={"ID":"09a150f4-ce59-4a5f-ad76-827136483007","Type":"ContainerStarted","Data":"7c250d36837548d5b4351d6697f8680a5f1f859d625c25d765a4bc9e16387816"} Jun 05 13:09:16.172726 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:16.172692 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:16.285942 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:16.285911 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:16.513565 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:16.513536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:16.684772 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:16.684744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:18.919027 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:18.918993 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:19.036072 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:19.036028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:21.324122 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:21.324071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:21.437301 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:21.437239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:22.508286 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:22.508244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" event={"ID":"09a150f4-ce59-4a5f-ad76-827136483007","Type":"ContainerStarted","Data":"2366e4946e7fd9fe452349eb228360556504ea6758dcff93980af6fa68de5606"} Jun 05 13:09:22.551453 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:22.551395 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lcq9x" podStartSLOduration=0.690719402 podStartE2EDuration="8.551378179s" totalImagesPullingTime="7.860658777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:09:22.548951892 +0000 UTC m=+497.240464868" watchObservedRunningTime="2026-06-05 13:09:22.551378179 +0000 UTC m=+497.242891153" Jun 05 13:09:23.020117 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.020053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:23.261309 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.261270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:23.544657 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.544618 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:23.734351 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.734322 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d"] Jun 05 13:09:23.737288 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.737273 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.744793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.744773 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:09:23.745322 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.745307 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zppkr\"" Jun 05 13:09:23.745746 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.745731 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:09:23.757572 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.757550 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d"] Jun 05 13:09:23.781288 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.781262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.781411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.781299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.781411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.781317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5mg\" (UniqueName: \"kubernetes.io/projected/ef36cc1e-bb63-4b41-9396-81a93d3ad500-kube-api-access-gs5mg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.882356 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.882270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.882356 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.882313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5mg\" (UniqueName: \"kubernetes.io/projected/ef36cc1e-bb63-4b41-9396-81a93d3ad500-kube-api-access-gs5mg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.882571 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.882408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.882635 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.882612 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.882732 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.882714 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:23.921514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:23.921489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5mg\" (UniqueName: \"kubernetes.io/projected/ef36cc1e-bb63-4b41-9396-81a93d3ad500-kube-api-access-gs5mg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:24.045776 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.045743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:24.238526 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:09:24.238492 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef36cc1e_bb63_4b41_9396_81a93d3ad500.slice/crio-0fbd070189c316f28639489fd8fb41bb00f5d579925934e8006c8e77304777a0 WatchSource:0}: Error finding container 0fbd070189c316f28639489fd8fb41bb00f5d579925934e8006c8e77304777a0: Status 404 returned error can't find the container with id 0fbd070189c316f28639489fd8fb41bb00f5d579925934e8006c8e77304777a0 Jun 05 13:09:24.242260 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.242238 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d"] Jun 05 13:09:24.518550 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.518472 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerID="0e7ca9dd50c53f3b25250dc45e4165753f49bc80a370f53506fc569320c2068a" exitCode=0 Jun 05 13:09:24.518550 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.518517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" event={"ID":"ef36cc1e-bb63-4b41-9396-81a93d3ad500","Type":"ContainerDied","Data":"0e7ca9dd50c53f3b25250dc45e4165753f49bc80a370f53506fc569320c2068a"} Jun 05 13:09:24.518717 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.518557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" event={"ID":"ef36cc1e-bb63-4b41-9396-81a93d3ad500","Type":"ContainerStarted","Data":"0fbd070189c316f28639489fd8fb41bb00f5d579925934e8006c8e77304777a0"} Jun 05 13:09:24.835242 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.835159 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm"] Jun 05 13:09:24.838227 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.838210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:24.841714 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.841690 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b6ctr\"" Jun 05 13:09:24.842517 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.842498 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 13:09:24.843305 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.843287 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 13:09:24.869209 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.869179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm"] Jun 05 13:09:24.889063 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.889038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6824b08-4ff9-4805-817c-53d6744ea7fc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6wvsm\" (UID: \"e6824b08-4ff9-4805-817c-53d6744ea7fc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:24.889172 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.889072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thbph\" (UniqueName: \"kubernetes.io/projected/e6824b08-4ff9-4805-817c-53d6744ea7fc-kube-api-access-thbph\") pod \"cert-manager-webhook-7dc76cbb94-6wvsm\" (UID: \"e6824b08-4ff9-4805-817c-53d6744ea7fc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:24.989602 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.989571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6824b08-4ff9-4805-817c-53d6744ea7fc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6wvsm\" (UID: \"e6824b08-4ff9-4805-817c-53d6744ea7fc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:24.989602 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:24.989604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thbph\" (UniqueName: \"kubernetes.io/projected/e6824b08-4ff9-4805-817c-53d6744ea7fc-kube-api-access-thbph\") pod \"cert-manager-webhook-7dc76cbb94-6wvsm\" (UID: \"e6824b08-4ff9-4805-817c-53d6744ea7fc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:25.008635 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:25.008607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6824b08-4ff9-4805-817c-53d6744ea7fc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6wvsm\" (UID: \"e6824b08-4ff9-4805-817c-53d6744ea7fc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:25.008742 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:25.008670 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thbph\" (UniqueName: \"kubernetes.io/projected/e6824b08-4ff9-4805-817c-53d6744ea7fc-kube-api-access-thbph\") pod \"cert-manager-webhook-7dc76cbb94-6wvsm\" (UID: \"e6824b08-4ff9-4805-817c-53d6744ea7fc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:25.156892 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:25.156822 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:25.325518 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:25.325365 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm"] Jun 05 13:09:25.331238 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:09:25.331194 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6824b08_4ff9_4805_817c_53d6744ea7fc.slice/crio-7141ce289ee74a3442d81c9eda25edf358d9951a8c9b0b0b9eb3fffa70f56897 WatchSource:0}: Error finding container 7141ce289ee74a3442d81c9eda25edf358d9951a8c9b0b0b9eb3fffa70f56897: Status 404 returned error can't find the container with id 7141ce289ee74a3442d81c9eda25edf358d9951a8c9b0b0b9eb3fffa70f56897 Jun 05 13:09:25.525520 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:25.525486 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" event={"ID":"e6824b08-4ff9-4805-817c-53d6744ea7fc","Type":"ContainerStarted","Data":"7141ce289ee74a3442d81c9eda25edf358d9951a8c9b0b0b9eb3fffa70f56897"} Jun 05 13:09:26.700533 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:26.700491 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:26.879259 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:26.879230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:27.537931 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:27.537894 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" event={"ID":"ef36cc1e-bb63-4b41-9396-81a93d3ad500","Type":"ContainerStarted","Data":"0ab86fe1e682c6c37b773aa8a2c7e29d88d2988b4dcf7b0ebd4914a522d6130a"} Jun 05 13:09:28.544823 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:28.544790 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerID="0ab86fe1e682c6c37b773aa8a2c7e29d88d2988b4dcf7b0ebd4914a522d6130a" exitCode=0 Jun 05 13:09:28.545333 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:28.544883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" event={"ID":"ef36cc1e-bb63-4b41-9396-81a93d3ad500","Type":"ContainerDied","Data":"0ab86fe1e682c6c37b773aa8a2c7e29d88d2988b4dcf7b0ebd4914a522d6130a"} Jun 05 13:09:28.546428 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:28.546403 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" event={"ID":"e6824b08-4ff9-4805-817c-53d6744ea7fc","Type":"ContainerStarted","Data":"6e472e3daf48f5be0bf8e5f1780f19ce106edfa134d10ed73e016da10c154f72"} Jun 05 13:09:28.546492 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:28.546470 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:28.605599 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:28.605552 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" podStartSLOduration=2.183878613 podStartE2EDuration="4.605533919s" totalImagesPullingTime="2.421655306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:09:28.603984979 +0000 UTC m=+503.295497954" watchObservedRunningTime="2026-06-05 13:09:28.605533919 +0000 UTC m=+503.297046895" Jun 05 13:09:29.553664 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:29.553632 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerID="ad2091b649e183105fa802587643fa4955bf738ec077f279008baf64b6bc774a" exitCode=0 Jun 05 13:09:29.554059 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:29.553729 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" event={"ID":"ef36cc1e-bb63-4b41-9396-81a93d3ad500","Type":"ContainerDied","Data":"ad2091b649e183105fa802587643fa4955bf738ec077f279008baf64b6bc774a"} Jun 05 13:09:30.685048 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.685024 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:30.739385 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.739359 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-bundle\") pod \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " Jun 05 13:09:30.739385 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.739388 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-util\") pod \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " Jun 05 13:09:30.739559 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.739436 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs5mg\" (UniqueName: \"kubernetes.io/projected/ef36cc1e-bb63-4b41-9396-81a93d3ad500-kube-api-access-gs5mg\") pod \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\" (UID: \"ef36cc1e-bb63-4b41-9396-81a93d3ad500\") " Jun 05 13:09:30.739763 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.739736 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-bundle" (OuterVolumeSpecName: "bundle") pod "ef36cc1e-bb63-4b41-9396-81a93d3ad500" (UID: "ef36cc1e-bb63-4b41-9396-81a93d3ad500"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:09:30.741596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.741566 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef36cc1e-bb63-4b41-9396-81a93d3ad500-kube-api-access-gs5mg" (OuterVolumeSpecName: "kube-api-access-gs5mg") pod "ef36cc1e-bb63-4b41-9396-81a93d3ad500" (UID: "ef36cc1e-bb63-4b41-9396-81a93d3ad500"). InnerVolumeSpecName "kube-api-access-gs5mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:09:30.745069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.745022 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-util" (OuterVolumeSpecName: "util") pod "ef36cc1e-bb63-4b41-9396-81a93d3ad500" (UID: "ef36cc1e-bb63-4b41-9396-81a93d3ad500"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:09:30.840291 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.840209 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:30.840291 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.840238 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef36cc1e-bb63-4b41-9396-81a93d3ad500-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:30.840291 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:30.840251 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs5mg\" (UniqueName: \"kubernetes.io/projected/ef36cc1e-bb63-4b41-9396-81a93d3ad500-kube-api-access-gs5mg\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:31.563872 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:31.563844 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" Jun 05 13:09:31.563872 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:31.563856 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj955d" event={"ID":"ef36cc1e-bb63-4b41-9396-81a93d3ad500","Type":"ContainerDied","Data":"0fbd070189c316f28639489fd8fb41bb00f5d579925934e8006c8e77304777a0"} Jun 05 13:09:31.564186 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:31.563895 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fbd070189c316f28639489fd8fb41bb00f5d579925934e8006c8e77304777a0" Jun 05 13:09:31.578508 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:31.578486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:31.795891 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:31.795859 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:33.970478 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970448 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-hlzsn"] Jun 05 13:09:33.970811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970735 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="extract" Jun 05 13:09:33.970811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970746 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="extract" Jun 05 13:09:33.970811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970760 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="util" Jun 05 13:09:33.970811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970765 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="util" Jun 05 13:09:33.970811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970778 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="pull" Jun 05 13:09:33.970811 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970783 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="pull" Jun 05 13:09:33.971020 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.970834 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef36cc1e-bb63-4b41-9396-81a93d3ad500" containerName="extract" Jun 05 13:09:33.972857 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.972841 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:33.988074 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:33.988051 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4pc9m\"" Jun 05 13:09:34.004128 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.004090 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-hlzsn"] Jun 05 13:09:34.048860 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.048829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:34.064077 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.064056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdlf6\" (UniqueName: \"kubernetes.io/projected/f7f25297-209e-445e-a36a-192a1e334e5b-kube-api-access-cdlf6\") pod \"cert-manager-59c77684cc-hlzsn\" (UID: \"f7f25297-209e-445e-a36a-192a1e334e5b\") " pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.064171 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.064135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7f25297-209e-445e-a36a-192a1e334e5b-bound-sa-token\") pod \"cert-manager-59c77684cc-hlzsn\" (UID: \"f7f25297-209e-445e-a36a-192a1e334e5b\") " pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.164455 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.164431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7f25297-209e-445e-a36a-192a1e334e5b-bound-sa-token\") pod \"cert-manager-59c77684cc-hlzsn\" (UID: \"f7f25297-209e-445e-a36a-192a1e334e5b\") " pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.164566 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.164475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdlf6\" (UniqueName: \"kubernetes.io/projected/f7f25297-209e-445e-a36a-192a1e334e5b-kube-api-access-cdlf6\") pod \"cert-manager-59c77684cc-hlzsn\" (UID: \"f7f25297-209e-445e-a36a-192a1e334e5b\") " pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.180034 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.180007 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdlf6\" (UniqueName: \"kubernetes.io/projected/f7f25297-209e-445e-a36a-192a1e334e5b-kube-api-access-cdlf6\") pod \"cert-manager-59c77684cc-hlzsn\" (UID: \"f7f25297-209e-445e-a36a-192a1e334e5b\") " pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.180878 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.180862 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7f25297-209e-445e-a36a-192a1e334e5b-bound-sa-token\") pod \"cert-manager-59c77684cc-hlzsn\" (UID: \"f7f25297-209e-445e-a36a-192a1e334e5b\") " pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.281199 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.281087 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-hlzsn" Jun 05 13:09:34.449200 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.449172 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-hlzsn"] Jun 05 13:09:34.556240 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.556165 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6wvsm" Jun 05 13:09:34.580685 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.580647 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-hlzsn" event={"ID":"f7f25297-209e-445e-a36a-192a1e334e5b","Type":"ContainerStarted","Data":"9b14efe50dd76e21eee9e7ed053f6a4a924b280ef3afc8d047bf2da13d1e6446"} Jun 05 13:09:34.580873 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.580695 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-hlzsn" event={"ID":"f7f25297-209e-445e-a36a-192a1e334e5b","Type":"ContainerStarted","Data":"9ddf8e88ffb4504863c3ac42edbb276f6f667978d6a039e1585187b1cef29093"} Jun 05 13:09:34.734337 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:34.734304 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:35.012127 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:35.012084 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:36.197787 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.197739 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-hlzsn" podStartSLOduration=3.197722158 podStartE2EDuration="3.197722158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:09:34.782454477 +0000 UTC m=+509.473967452" watchObservedRunningTime="2026-06-05 13:09:36.197722158 +0000 UTC m=+510.889235133" Jun 05 13:09:36.198235 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.198087 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq"] Jun 05 13:09:36.200115 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.200086 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.204889 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.204867 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 13:09:36.205765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.205748 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:09:36.205765 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.205756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fhq8b\"" Jun 05 13:09:36.233156 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.233131 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq"] Jun 05 13:09:36.282553 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.282522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-486zc\" (UniqueName: \"kubernetes.io/projected/9e558016-279e-4c93-a1e5-35009382d2c4-kube-api-access-486zc\") pod \"openshift-lws-operator-fd8ccff4c-pkvcq\" (UID: \"9e558016-279e-4c93-a1e5-35009382d2c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.282698 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.282566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e558016-279e-4c93-a1e5-35009382d2c4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkvcq\" (UID: \"9e558016-279e-4c93-a1e5-35009382d2c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.383613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.383583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e558016-279e-4c93-a1e5-35009382d2c4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkvcq\" (UID: \"9e558016-279e-4c93-a1e5-35009382d2c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.383748 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.383646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-486zc\" (UniqueName: \"kubernetes.io/projected/9e558016-279e-4c93-a1e5-35009382d2c4-kube-api-access-486zc\") pod \"openshift-lws-operator-fd8ccff4c-pkvcq\" (UID: \"9e558016-279e-4c93-a1e5-35009382d2c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.384033 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.384011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e558016-279e-4c93-a1e5-35009382d2c4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkvcq\" (UID: \"9e558016-279e-4c93-a1e5-35009382d2c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.399564 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.399540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-486zc\" (UniqueName: \"kubernetes.io/projected/9e558016-279e-4c93-a1e5-35009382d2c4-kube-api-access-486zc\") pod \"openshift-lws-operator-fd8ccff4c-pkvcq\" (UID: \"9e558016-279e-4c93-a1e5-35009382d2c4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.509568 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.509527 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" Jun 05 13:09:36.691244 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:36.691211 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq"] Jun 05 13:09:36.703302 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:09:36.703251 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e558016_279e_4c93_a1e5_35009382d2c4.slice/crio-193293cf5cc7aad6e602563aee9c4f63f33fb440f8396fc34324cbf64d44c19a WatchSource:0}: Error finding container 193293cf5cc7aad6e602563aee9c4f63f33fb440f8396fc34324cbf64d44c19a: Status 404 returned error can't find the container with id 193293cf5cc7aad6e602563aee9c4f63f33fb440f8396fc34324cbf64d44c19a Jun 05 13:09:37.606825 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:37.606790 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" event={"ID":"9e558016-279e-4c93-a1e5-35009382d2c4","Type":"ContainerStarted","Data":"193293cf5cc7aad6e602563aee9c4f63f33fb440f8396fc34324cbf64d44c19a"} Jun 05 13:09:40.622476 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:40.622401 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" event={"ID":"9e558016-279e-4c93-a1e5-35009382d2c4","Type":"ContainerStarted","Data":"dc410c85dbcaaa254e0ae0301bfae3314175532bab2b2b8be99b1eedb336051b"} Jun 05 13:09:40.657579 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:40.657536 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkvcq" podStartSLOduration=1.063809067 podStartE2EDuration="4.657519999s" totalImagesPullingTime="3.593710932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:09:40.65699578 +0000 UTC m=+515.348508757" watchObservedRunningTime="2026-06-05 13:09:40.657519999 +0000 UTC m=+515.349032976" Jun 05 13:09:41.572329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:41.572296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:41.871727 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:41.871651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:43.090794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.090758 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v"] Jun 05 13:09:43.093265 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.093249 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.098829 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.098804 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zppkr\"" Jun 05 13:09:43.098960 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.098807 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:09:43.099561 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.099506 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:09:43.131149 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.131123 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v"] Jun 05 13:09:43.254766 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.254736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.254914 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.254771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2c9s\" (UniqueName: \"kubernetes.io/projected/e5c1c3cc-669a-455b-b09f-31ed72d58d01-kube-api-access-j2c9s\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.254914 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.254792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.312865 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.312830 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:43.355658 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.355590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.355658 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.355633 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2c9s\" (UniqueName: \"kubernetes.io/projected/e5c1c3cc-669a-455b-b09f-31ed72d58d01-kube-api-access-j2c9s\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.355851 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.355664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.355970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.355948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.356006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.355962 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.369918 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.369887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2c9s\" (UniqueName: \"kubernetes.io/projected/e5c1c3cc-669a-455b-b09f-31ed72d58d01-kube-api-access-j2c9s\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.401859 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.401835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:43.538948 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.538811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v"] Jun 05 13:09:43.541492 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:09:43.541467 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c1c3cc_669a_455b_b09f_31ed72d58d01.slice/crio-a94ead91f6a8a75695d950f00e6c36f929fd8c2b071849c88fca7672adeda3e8 WatchSource:0}: Error finding container a94ead91f6a8a75695d950f00e6c36f929fd8c2b071849c88fca7672adeda3e8: Status 404 returned error can't find the container with id a94ead91f6a8a75695d950f00e6c36f929fd8c2b071849c88fca7672adeda3e8 Jun 05 13:09:43.639638 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.639609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" event={"ID":"e5c1c3cc-669a-455b-b09f-31ed72d58d01","Type":"ContainerStarted","Data":"b4e9dc4ffe18e79eac5c0212d15f489abaeb0bbc57747f6775db138e405d521b"} Jun 05 13:09:43.639758 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:43.639657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" event={"ID":"e5c1c3cc-669a-455b-b09f-31ed72d58d01","Type":"ContainerStarted","Data":"a94ead91f6a8a75695d950f00e6c36f929fd8c2b071849c88fca7672adeda3e8"} Jun 05 13:09:44.645555 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:44.645468 2558 generic.go:356] "Generic (PLEG): container finished" podID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerID="b4e9dc4ffe18e79eac5c0212d15f489abaeb0bbc57747f6775db138e405d521b" exitCode=0 Jun 05 13:09:44.645555 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:44.645528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" event={"ID":"e5c1c3cc-669a-455b-b09f-31ed72d58d01","Type":"ContainerDied","Data":"b4e9dc4ffe18e79eac5c0212d15f489abaeb0bbc57747f6775db138e405d521b"} Jun 05 13:09:45.652261 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:45.652177 2558 generic.go:356] "Generic (PLEG): container finished" podID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerID="cbf4d5a49a991936ebf35f179423b9ee2ccb4a3ad74d696e017590bba1bc759e" exitCode=0 Jun 05 13:09:45.652614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:45.652267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" event={"ID":"e5c1c3cc-669a-455b-b09f-31ed72d58d01","Type":"ContainerDied","Data":"cbf4d5a49a991936ebf35f179423b9ee2ccb4a3ad74d696e017590bba1bc759e"} Jun 05 13:09:46.658885 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:46.658852 2558 generic.go:356] "Generic (PLEG): container finished" podID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerID="4bda5d945798156c42f60a2f799a466509c4d8702bd49ab9d70584d14ac062e3" exitCode=0 Jun 05 13:09:46.659277 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:46.658900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" event={"ID":"e5c1c3cc-669a-455b-b09f-31ed72d58d01","Type":"ContainerDied","Data":"4bda5d945798156c42f60a2f799a466509c4d8702bd49ab9d70584d14ac062e3"} Jun 05 13:09:47.788580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.788558 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:47.893020 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.892990 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-bundle\") pod \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " Jun 05 13:09:47.893020 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.893023 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-util\") pod \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " Jun 05 13:09:47.893201 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.893042 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2c9s\" (UniqueName: \"kubernetes.io/projected/e5c1c3cc-669a-455b-b09f-31ed72d58d01-kube-api-access-j2c9s\") pod \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\" (UID: \"e5c1c3cc-669a-455b-b09f-31ed72d58d01\") " Jun 05 13:09:47.893641 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.893610 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-bundle" (OuterVolumeSpecName: "bundle") pod "e5c1c3cc-669a-455b-b09f-31ed72d58d01" (UID: "e5c1c3cc-669a-455b-b09f-31ed72d58d01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:09:47.895031 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.895008 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c1c3cc-669a-455b-b09f-31ed72d58d01-kube-api-access-j2c9s" (OuterVolumeSpecName: "kube-api-access-j2c9s") pod "e5c1c3cc-669a-455b-b09f-31ed72d58d01" (UID: "e5c1c3cc-669a-455b-b09f-31ed72d58d01"). InnerVolumeSpecName "kube-api-access-j2c9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:09:47.898443 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.898422 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-util" (OuterVolumeSpecName: "util") pod "e5c1c3cc-669a-455b-b09f-31ed72d58d01" (UID: "e5c1c3cc-669a-455b-b09f-31ed72d58d01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:09:47.993922 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.993884 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:47.993922 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.993917 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c1c3cc-669a-455b-b09f-31ed72d58d01-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:47.993922 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:47.993926 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2c9s\" (UniqueName: \"kubernetes.io/projected/e5c1c3cc-669a-455b-b09f-31ed72d58d01-kube-api-access-j2c9s\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:09:48.669142 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:48.669116 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" Jun 05 13:09:48.669142 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:48.669132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlgs9v" event={"ID":"e5c1c3cc-669a-455b-b09f-31ed72d58d01","Type":"ContainerDied","Data":"a94ead91f6a8a75695d950f00e6c36f929fd8c2b071849c88fca7672adeda3e8"} Jun 05 13:09:48.669336 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:48.669182 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a94ead91f6a8a75695d950f00e6c36f929fd8c2b071849c88fca7672adeda3e8" Jun 05 13:09:54.787657 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:54.787572 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:54.956616 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:54.956588 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:55.339263 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:55.339227 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:56.236043 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.236009 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:56.424840 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.424803 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:56.484151 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484120 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb"] Jun 05 13:09:56.484432 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484420 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="pull" Jun 05 13:09:56.484471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484433 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="pull" Jun 05 13:09:56.484471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484452 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="extract" Jun 05 13:09:56.484471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484457 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="extract" Jun 05 13:09:56.484471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484465 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="util" Jun 05 13:09:56.484471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484470 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="util" Jun 05 13:09:56.484615 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.484521 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5c1c3cc-669a-455b-b09f-31ed72d58d01" containerName="extract" Jun 05 13:09:56.486663 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.486623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.489726 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.489706 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 13:09:56.489826 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.489708 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 13:09:56.490852 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.490835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hk5v6\"" Jun 05 13:09:56.492275 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.492253 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 13:09:56.492454 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.492418 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 13:09:56.569971 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.567809 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb"] Jun 05 13:09:56.661637 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.661608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3037e423-b649-4e40-9b10-1b534af8acbd-manifests\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.661794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.661649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3037e423-b649-4e40-9b10-1b534af8acbd-webhook-cert\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.661794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.661684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3037e423-b649-4e40-9b10-1b534af8acbd-tmp\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.661794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.661745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7rxv\" (UniqueName: \"kubernetes.io/projected/3037e423-b649-4e40-9b10-1b534af8acbd-kube-api-access-v7rxv\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.661794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.661768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3037e423-b649-4e40-9b10-1b534af8acbd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.763194 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.763114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7rxv\" (UniqueName: \"kubernetes.io/projected/3037e423-b649-4e40-9b10-1b534af8acbd-kube-api-access-v7rxv\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.763194 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.763154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3037e423-b649-4e40-9b10-1b534af8acbd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.763426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.763222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3037e423-b649-4e40-9b10-1b534af8acbd-manifests\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.763426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.763256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3037e423-b649-4e40-9b10-1b534af8acbd-webhook-cert\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.763426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.763292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3037e423-b649-4e40-9b10-1b534af8acbd-tmp\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.763686 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.763658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3037e423-b649-4e40-9b10-1b534af8acbd-manifests\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.765551 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.765530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3037e423-b649-4e40-9b10-1b534af8acbd-tmp\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.765676 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.765659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3037e423-b649-4e40-9b10-1b534af8acbd-webhook-cert\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.765807 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.765792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3037e423-b649-4e40-9b10-1b534af8acbd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.803755 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.803736 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7rxv\" (UniqueName: \"kubernetes.io/projected/3037e423-b649-4e40-9b10-1b534af8acbd-kube-api-access-v7rxv\") pod \"opendatahub-operator-controller-manager-785744655b-9h9gb\" (UID: \"3037e423-b649-4e40-9b10-1b534af8acbd\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:56.913182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:56.913150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:57.096644 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:57.096563 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:09:57.240550 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:57.240518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:57.309931 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:57.309899 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb"] Jun 05 13:09:57.317263 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:09:57.317235 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3037e423_b649_4e40_9b10_1b534af8acbd.slice/crio-78d041a0b00debfcc0528c458bc069309068a498dca3a7dc47cba308375b80f5 WatchSource:0}: Error finding container 78d041a0b00debfcc0528c458bc069309068a498dca3a7dc47cba308375b80f5: Status 404 returned error can't find the container with id 78d041a0b00debfcc0528c458bc069309068a498dca3a7dc47cba308375b80f5 Jun 05 13:09:57.528531 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:57.528497 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:57.710941 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:57.710893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" event={"ID":"3037e423-b649-4e40-9b10-1b534af8acbd","Type":"ContainerStarted","Data":"78d041a0b00debfcc0528c458bc069309068a498dca3a7dc47cba308375b80f5"} Jun 05 13:09:57.924632 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:57.924552 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:09:58.296469 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:09:58.296437 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:00.727259 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:00.727226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" event={"ID":"3037e423-b649-4e40-9b10-1b534af8acbd","Type":"ContainerStarted","Data":"610b71b8f2c0a777913459f7a58228cfcd07e1fbad4caa3ee37b3c494a92b17e"} Jun 05 13:10:01.733536 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:01.733505 2558 generic.go:356] "Generic (PLEG): container finished" podID="3037e423-b649-4e40-9b10-1b534af8acbd" containerID="610b71b8f2c0a777913459f7a58228cfcd07e1fbad4caa3ee37b3c494a92b17e" exitCode=0 Jun 05 13:10:01.733918 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:01.733600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" event={"ID":"3037e423-b649-4e40-9b10-1b534af8acbd","Type":"ContainerDied","Data":"610b71b8f2c0a777913459f7a58228cfcd07e1fbad4caa3ee37b3c494a92b17e"} Jun 05 13:10:02.739606 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:02.739574 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" event={"ID":"3037e423-b649-4e40-9b10-1b534af8acbd","Type":"ContainerStarted","Data":"49ddf376e112f3f0062dbbd958a6f819be02d58f34d2c46249c8e4cdcb846e4b"} Jun 05 13:10:02.739974 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:02.739659 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:10:02.823681 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:02.823634 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" podStartSLOduration=2.693538228 podStartE2EDuration="6.823620661s" totalImagesPullingTime="3.198823864s" totalInitContainerRuntime="931.258569ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:02.822254728 +0000 UTC m=+537.513767719" watchObservedRunningTime="2026-06-05 13:10:02.823620661 +0000 UTC m=+537.515133635" Jun 05 13:10:07.807759 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:07.807729 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:08.037287 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:08.037253 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:13.746532 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:13.746506 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-9h9gb" Jun 05 13:10:15.903016 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:15.902983 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:16.196611 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:16.196533 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:17.091048 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.090998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:17.471045 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.471013 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:17.931419 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.931336 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f"] Jun 05 13:10:17.940940 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.940920 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:17.960756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.960734 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zppkr\"" Jun 05 13:10:17.960872 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.960763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:10:17.960872 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:17.960833 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:10:18.037430 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.037407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f"] Jun 05 13:10:18.038871 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.038852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmn52\" (UniqueName: \"kubernetes.io/projected/6fca9e45-b428-4bdd-9921-3fa95dfd70be-kube-api-access-jmn52\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.038965 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.038890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.038965 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.038923 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.140144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.140096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmn52\" (UniqueName: \"kubernetes.io/projected/6fca9e45-b428-4bdd-9921-3fa95dfd70be-kube-api-access-jmn52\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.140495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.140156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.140495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.140221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.140572 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.140505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.140610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.140595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.156329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.156304 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-pdg9m"] Jun 05 13:10:18.158424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.158410 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.208372 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.208347 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 13:10:18.208514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.208464 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r8x26\"" Jun 05 13:10:18.223094 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.223073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:18.225358 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.225338 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t"] Jun 05 13:10:18.227595 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.227579 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.236034 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.236017 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-llk6x\"" Jun 05 13:10:18.240701 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.240683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5086f65-a31a-4fba-a70d-185568d174c3-cert\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.240779 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.240719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5w67\" (UniqueName: \"kubernetes.io/projected/b5086f65-a31a-4fba-a70d-185568d174c3-kube-api-access-z5w67\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.248472 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.248454 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmn52\" (UniqueName: \"kubernetes.io/projected/6fca9e45-b428-4bdd-9921-3fa95dfd70be-kube-api-access-jmn52\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.250179 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.250164 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:18.263862 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.263840 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-pdg9m"] Jun 05 13:10:18.267437 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.267419 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 13:10:18.277650 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.277619 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 13:10:18.318605 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.318549 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t"] Jun 05 13:10:18.341770 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.341739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjtg\" (UniqueName: \"kubernetes.io/projected/4c226ba7-f0a6-468b-99fe-9ef0719195e4-kube-api-access-6bjtg\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.341897 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.341840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5086f65-a31a-4fba-a70d-185568d174c3-cert\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.341897 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.341886 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5w67\" (UniqueName: \"kubernetes.io/projected/b5086f65-a31a-4fba-a70d-185568d174c3-kube-api-access-z5w67\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.342027 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.342010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c226ba7-f0a6-468b-99fe-9ef0719195e4-tmp\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.342090 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:10:18.342018 2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 13:10:18.342090 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.342052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c226ba7-f0a6-468b-99fe-9ef0719195e4-tls-certs\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.342213 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:10:18.342110 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5086f65-a31a-4fba-a70d-185568d174c3-cert podName:b5086f65-a31a-4fba-a70d-185568d174c3 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:18.842069527 +0000 UTC m=+553.533582483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b5086f65-a31a-4fba-a70d-185568d174c3-cert") pod "odh-model-controller-6dc94f689f-pdg9m" (UID: "b5086f65-a31a-4fba-a70d-185568d174c3") : secret "odh-model-controller-webhook-cert" not found Jun 05 13:10:18.443028 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.442975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c226ba7-f0a6-468b-99fe-9ef0719195e4-tmp\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.443028 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.443027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c226ba7-f0a6-468b-99fe-9ef0719195e4-tls-certs\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.443300 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.443078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjtg\" (UniqueName: \"kubernetes.io/projected/4c226ba7-f0a6-468b-99fe-9ef0719195e4-kube-api-access-6bjtg\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.445531 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.445484 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c226ba7-f0a6-468b-99fe-9ef0719195e4-tmp\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.445713 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.445695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c226ba7-f0a6-468b-99fe-9ef0719195e4-tls-certs\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.502196 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.502074 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f"] Jun 05 13:10:18.511519 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:18.511492 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fca9e45_b428_4bdd_9921_3fa95dfd70be.slice/crio-dd59468e36781db38cdcc11d970adda1f567ebd279f76a7801bd6eb24014c7db WatchSource:0}: Error finding container dd59468e36781db38cdcc11d970adda1f567ebd279f76a7801bd6eb24014c7db: Status 404 returned error can't find the container with id dd59468e36781db38cdcc11d970adda1f567ebd279f76a7801bd6eb24014c7db Jun 05 13:10:18.561637 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.561614 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjtg\" (UniqueName: \"kubernetes.io/projected/4c226ba7-f0a6-468b-99fe-9ef0719195e4-kube-api-access-6bjtg\") pod \"kube-auth-proxy-74b6cf7bfb-cjj6t\" (UID: \"4c226ba7-f0a6-468b-99fe-9ef0719195e4\") " pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.632010 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.631985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5w67\" (UniqueName: \"kubernetes.io/projected/b5086f65-a31a-4fba-a70d-185568d174c3-kube-api-access-z5w67\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.666787 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.666756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:18.813465 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.813372 2558 generic.go:356] "Generic (PLEG): container finished" podID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerID="490c508af7701d595b9b081b072d6c8e911584ff8ec39adc373406fbfcc5e94d" exitCode=0 Jun 05 13:10:18.813641 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.813461 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" event={"ID":"6fca9e45-b428-4bdd-9921-3fa95dfd70be","Type":"ContainerDied","Data":"490c508af7701d595b9b081b072d6c8e911584ff8ec39adc373406fbfcc5e94d"} Jun 05 13:10:18.813641 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.813515 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" event={"ID":"6fca9e45-b428-4bdd-9921-3fa95dfd70be","Type":"ContainerStarted","Data":"dd59468e36781db38cdcc11d970adda1f567ebd279f76a7801bd6eb24014c7db"} Jun 05 13:10:18.836774 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.836750 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" Jun 05 13:10:18.851341 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.851310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5086f65-a31a-4fba-a70d-185568d174c3-cert\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:18.854471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:18.854450 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5086f65-a31a-4fba-a70d-185568d174c3-cert\") pod \"odh-model-controller-6dc94f689f-pdg9m\" (UID: \"b5086f65-a31a-4fba-a70d-185568d174c3\") " pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:19.036862 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:19.036832 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c226ba7_f0a6_468b_99fe_9ef0719195e4.slice/crio-b754a55b2bec7a01239caefaf0d83c9df79cf792d83e8061bc2d0cac66b95ea8 WatchSource:0}: Error finding container b754a55b2bec7a01239caefaf0d83c9df79cf792d83e8061bc2d0cac66b95ea8: Status 404 returned error can't find the container with id b754a55b2bec7a01239caefaf0d83c9df79cf792d83e8061bc2d0cac66b95ea8 Jun 05 13:10:19.037613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:19.037593 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t"] Jun 05 13:10:19.065458 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:19.065391 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:19.070276 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:19.070256 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:19.278813 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:19.278780 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-pdg9m"] Jun 05 13:10:19.285788 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:19.285759 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5086f65_a31a_4fba_a70d_185568d174c3.slice/crio-b490247809e4ec0970609c8a4ecec7ddd1ed3eba6b79ea8d20bb49bbf9e4a5e5 WatchSource:0}: Error finding container b490247809e4ec0970609c8a4ecec7ddd1ed3eba6b79ea8d20bb49bbf9e4a5e5: Status 404 returned error can't find the container with id b490247809e4ec0970609c8a4ecec7ddd1ed3eba6b79ea8d20bb49bbf9e4a5e5 Jun 05 13:10:19.823174 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:19.823137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" event={"ID":"b5086f65-a31a-4fba-a70d-185568d174c3","Type":"ContainerStarted","Data":"b490247809e4ec0970609c8a4ecec7ddd1ed3eba6b79ea8d20bb49bbf9e4a5e5"} Jun 05 13:10:19.824801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:19.824747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" event={"ID":"4c226ba7-f0a6-468b-99fe-9ef0719195e4","Type":"ContainerStarted","Data":"b754a55b2bec7a01239caefaf0d83c9df79cf792d83e8061bc2d0cac66b95ea8"} Jun 05 13:10:20.701796 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.701758 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dn2vt"] Jun 05 13:10:20.710874 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.710840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:20.737225 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.737191 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wqm9x\"" Jun 05 13:10:20.751977 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.751947 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 13:10:20.769991 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.769964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b69440b-104c-4148-b330-75a097405ca5-tls-certs\") pod \"model-serving-api-5dd488fc48-dn2vt\" (UID: \"2b69440b-104c-4148-b330-75a097405ca5\") " pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:20.770165 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.770141 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlsl\" (UniqueName: \"kubernetes.io/projected/2b69440b-104c-4148-b330-75a097405ca5-kube-api-access-2nlsl\") pod \"model-serving-api-5dd488fc48-dn2vt\" (UID: \"2b69440b-104c-4148-b330-75a097405ca5\") " pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:20.833252 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.833163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dn2vt"] Jun 05 13:10:20.836951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.835484 2558 generic.go:356] "Generic (PLEG): container finished" podID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerID="d8ea59ac597109b5a72516f6165d8250a9e72201ee8e0dd1b0bc4e66d0ad724c" exitCode=0 Jun 05 13:10:20.836951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.835653 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" event={"ID":"6fca9e45-b428-4bdd-9921-3fa95dfd70be","Type":"ContainerDied","Data":"d8ea59ac597109b5a72516f6165d8250a9e72201ee8e0dd1b0bc4e66d0ad724c"} Jun 05 13:10:20.871444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.871278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlsl\" (UniqueName: \"kubernetes.io/projected/2b69440b-104c-4148-b330-75a097405ca5-kube-api-access-2nlsl\") pod \"model-serving-api-5dd488fc48-dn2vt\" (UID: \"2b69440b-104c-4148-b330-75a097405ca5\") " pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:20.871444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.871328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b69440b-104c-4148-b330-75a097405ca5-tls-certs\") pod \"model-serving-api-5dd488fc48-dn2vt\" (UID: \"2b69440b-104c-4148-b330-75a097405ca5\") " pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:20.874602 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.874555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b69440b-104c-4148-b330-75a097405ca5-tls-certs\") pod \"model-serving-api-5dd488fc48-dn2vt\" (UID: \"2b69440b-104c-4148-b330-75a097405ca5\") " pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:20.877699 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.877596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:20.906262 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:20.906203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlsl\" (UniqueName: \"kubernetes.io/projected/2b69440b-104c-4148-b330-75a097405ca5-kube-api-access-2nlsl\") pod \"model-serving-api-5dd488fc48-dn2vt\" (UID: \"2b69440b-104c-4148-b330-75a097405ca5\") " pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:21.025946 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:21.025914 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:21.312380 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:21.312280 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:23.283676 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.283637 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dn2vt"] Jun 05 13:10:23.292081 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:23.292051 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b69440b_104c_4148_b330_75a097405ca5.slice/crio-774301f1258b9ae6f292ea843224b7e7eb2af13e645523738514524e69130488 WatchSource:0}: Error finding container 774301f1258b9ae6f292ea843224b7e7eb2af13e645523738514524e69130488: Status 404 returned error can't find the container with id 774301f1258b9ae6f292ea843224b7e7eb2af13e645523738514524e69130488 Jun 05 13:10:23.853511 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.853448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" event={"ID":"4c226ba7-f0a6-468b-99fe-9ef0719195e4","Type":"ContainerStarted","Data":"81f4bdaac82948ae74d17a8ed8342b704868bef70356fecd1b1654dd65fe2752"} Jun 05 13:10:23.854791 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.854764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" event={"ID":"2b69440b-104c-4148-b330-75a097405ca5","Type":"ContainerStarted","Data":"774301f1258b9ae6f292ea843224b7e7eb2af13e645523738514524e69130488"} Jun 05 13:10:23.856782 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.856758 2558 generic.go:356] "Generic (PLEG): container finished" podID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerID="e56a9369b1ebb82e9781269b1847a49a79816c617b05fa63e0395da181a66626" exitCode=0 Jun 05 13:10:23.856884 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.856816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" event={"ID":"6fca9e45-b428-4bdd-9921-3fa95dfd70be","Type":"ContainerDied","Data":"e56a9369b1ebb82e9781269b1847a49a79816c617b05fa63e0395da181a66626"} Jun 05 13:10:23.858151 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.858126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" event={"ID":"b5086f65-a31a-4fba-a70d-185568d174c3","Type":"ContainerStarted","Data":"3e35ed3e33580ac0ecd28dc558af73e9a6551010e91129dee1efcfea950e4e82"} Jun 05 13:10:23.858242 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.858188 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:23.981221 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:23.981154 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74b6cf7bfb-cjj6t" podStartSLOduration=1.9778834509999998 podStartE2EDuration="5.981133495s" totalImagesPullingTime="4.003250044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:23.980347831 +0000 UTC m=+558.671860813" watchObservedRunningTime="2026-06-05 13:10:23.981133495 +0000 UTC m=+558.672646471" Jun 05 13:10:24.076359 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:24.076309 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" podStartSLOduration=3.267615747 podStartE2EDuration="7.07629233s" totalImagesPullingTime="3.808676583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:24.07496629 +0000 UTC m=+558.766479264" watchObservedRunningTime="2026-06-05 13:10:24.07629233 +0000 UTC m=+558.767805306" Jun 05 13:10:25.074279 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.074251 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:25.212004 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.211976 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-bundle\") pod \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " Jun 05 13:10:25.212178 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.212064 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmn52\" (UniqueName: \"kubernetes.io/projected/6fca9e45-b428-4bdd-9921-3fa95dfd70be-kube-api-access-jmn52\") pod \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " Jun 05 13:10:25.212178 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.212128 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-util\") pod \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\" (UID: \"6fca9e45-b428-4bdd-9921-3fa95dfd70be\") " Jun 05 13:10:25.212783 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.212750 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-bundle" (OuterVolumeSpecName: "bundle") pod "6fca9e45-b428-4bdd-9921-3fa95dfd70be" (UID: "6fca9e45-b428-4bdd-9921-3fa95dfd70be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:10:25.214032 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.214014 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fca9e45-b428-4bdd-9921-3fa95dfd70be-kube-api-access-jmn52" (OuterVolumeSpecName: "kube-api-access-jmn52") pod "6fca9e45-b428-4bdd-9921-3fa95dfd70be" (UID: "6fca9e45-b428-4bdd-9921-3fa95dfd70be"). InnerVolumeSpecName "kube-api-access-jmn52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:10:25.216666 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.216646 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-util" (OuterVolumeSpecName: "util") pod "6fca9e45-b428-4bdd-9921-3fa95dfd70be" (UID: "6fca9e45-b428-4bdd-9921-3fa95dfd70be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:10:25.313485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.313456 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:10:25.313485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.313480 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fca9e45-b428-4bdd-9921-3fa95dfd70be-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:10:25.313485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.313489 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmn52\" (UniqueName: \"kubernetes.io/projected/6fca9e45-b428-4bdd-9921-3fa95dfd70be-kube-api-access-jmn52\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:10:25.873234 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.873199 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" event={"ID":"2b69440b-104c-4148-b330-75a097405ca5","Type":"ContainerStarted","Data":"0d53633ab94c55e0fb4f4438d6495f96b8872561cff27d8df802681810f6aa97"} Jun 05 13:10:25.873412 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.873299 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:25.875209 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.875177 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" Jun 05 13:10:25.875209 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.875186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tmp9f" event={"ID":"6fca9e45-b428-4bdd-9921-3fa95dfd70be","Type":"ContainerDied","Data":"dd59468e36781db38cdcc11d970adda1f567ebd279f76a7801bd6eb24014c7db"} Jun 05 13:10:25.875357 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.875219 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd59468e36781db38cdcc11d970adda1f567ebd279f76a7801bd6eb24014c7db" Jun 05 13:10:25.932545 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:25.932505 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" podStartSLOduration=4.121073822 podStartE2EDuration="5.932491568s" totalImagesPullingTime="1.811417746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:25.931345399 +0000 UTC m=+560.622858374" watchObservedRunningTime="2026-06-05 13:10:25.932491568 +0000 UTC m=+560.624004543" Jun 05 13:10:34.005547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:34.005517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:34.869800 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:34.869772 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-pdg9m" Jun 05 13:10:35.444274 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.444246 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:35.600830 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.600800 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k"] Jun 05 13:10:35.601146 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601133 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="util" Jun 05 13:10:35.601202 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601147 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="util" Jun 05 13:10:35.601202 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601166 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="pull" Jun 05 13:10:35.601202 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601171 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="pull" Jun 05 13:10:35.601202 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601177 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="extract" Jun 05 13:10:35.601202 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601182 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="extract" Jun 05 13:10:35.601354 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.601244 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fca9e45-b428-4bdd-9921-3fa95dfd70be" containerName="extract" Jun 05 13:10:35.605797 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.605776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.613182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.613160 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zppkr\"" Jun 05 13:10:35.613340 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.613328 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:10:35.622208 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.622189 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:10:35.666444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.666415 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k"] Jun 05 13:10:35.700194 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.700121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.700194 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.700166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.700194 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.700211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shndh\" (UniqueName: \"kubernetes.io/projected/a07ed249-1f07-4a80-bca5-9836cad008b8-kube-api-access-shndh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.801598 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.801569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.801756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.801604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.801756 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.801635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shndh\" (UniqueName: \"kubernetes.io/projected/a07ed249-1f07-4a80-bca5-9836cad008b8-kube-api-access-shndh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.802018 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.801988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.802091 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.802022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.845648 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.845623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shndh\" (UniqueName: \"kubernetes.io/projected/a07ed249-1f07-4a80-bca5-9836cad008b8-kube-api-access-shndh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:35.914801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:35.914771 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:36.108959 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:36.108933 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k"] Jun 05 13:10:36.111007 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:36.110981 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07ed249_1f07_4a80_bca5_9836cad008b8.slice/crio-4792971da1da4f2c614532acf5c74cdb1d7c4da72095cc79ef3d684d33d6f645 WatchSource:0}: Error finding container 4792971da1da4f2c614532acf5c74cdb1d7c4da72095cc79ef3d684d33d6f645: Status 404 returned error can't find the container with id 4792971da1da4f2c614532acf5c74cdb1d7c4da72095cc79ef3d684d33d6f645 Jun 05 13:10:36.884804 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:36.884773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-dn2vt" Jun 05 13:10:36.904609 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:36.904583 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:36.934657 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:36.934631 2558 generic.go:356] "Generic (PLEG): container finished" podID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerID="6ba9143f672adfbba2d2eb1d57a86d8a9d209e42b859b537f9e34017d7f139d0" exitCode=0 Jun 05 13:10:36.934781 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:36.934662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" event={"ID":"a07ed249-1f07-4a80-bca5-9836cad008b8","Type":"ContainerDied","Data":"6ba9143f672adfbba2d2eb1d57a86d8a9d209e42b859b537f9e34017d7f139d0"} Jun 05 13:10:36.934781 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:36.934729 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" event={"ID":"a07ed249-1f07-4a80-bca5-9836cad008b8","Type":"ContainerStarted","Data":"4792971da1da4f2c614532acf5c74cdb1d7c4da72095cc79ef3d684d33d6f645"} Jun 05 13:10:37.530028 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.529987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:37.896590 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.896467 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:37.941610 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.941580 2558 generic.go:356] "Generic (PLEG): container finished" podID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerID="b2b3280afdcae00c71b821d912606cd72952517bcf0507ea98730a10f6cbc1d9" exitCode=0 Jun 05 13:10:37.941741 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.941631 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" event={"ID":"a07ed249-1f07-4a80-bca5-9836cad008b8","Type":"ContainerDied","Data":"b2b3280afdcae00c71b821d912606cd72952517bcf0507ea98730a10f6cbc1d9"} Jun 05 13:10:37.967441 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.967415 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wq2cq"] Jun 05 13:10:37.971902 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.971883 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:37.992355 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.992331 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 13:10:37.992460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:37.992331 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wltqn\"" Jun 05 13:10:38.000095 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.000074 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg"] Jun 05 13:10:38.003340 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.003325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.024707 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.024689 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 13:10:38.025015 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.024983 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-grz6q\"" Jun 05 13:10:38.036963 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.036747 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wq2cq"] Jun 05 13:10:38.043836 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.043808 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg"] Jun 05 13:10:38.119953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.119919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be89fdbf-23cf-435b-a974-0b99ccfb8715-cert\") pod \"kserve-controller-manager-69fc866d76-wq2cq\" (UID: \"be89fdbf-23cf-435b-a974-0b99ccfb8715\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.119953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.119954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbb1f14-e919-4718-9ed3-97f5b2e18186-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vr7wg\" (UID: \"8cbb1f14-e919-4718-9ed3-97f5b2e18186\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.120177 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.119983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87np\" (UniqueName: \"kubernetes.io/projected/8cbb1f14-e919-4718-9ed3-97f5b2e18186-kube-api-access-p87np\") pod \"llmisvc-controller-manager-864bfd7bc9-vr7wg\" (UID: \"8cbb1f14-e919-4718-9ed3-97f5b2e18186\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.120177 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.120002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4w7\" (UniqueName: \"kubernetes.io/projected/be89fdbf-23cf-435b-a974-0b99ccfb8715-kube-api-access-2k4w7\") pod \"kserve-controller-manager-69fc866d76-wq2cq\" (UID: \"be89fdbf-23cf-435b-a974-0b99ccfb8715\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.220512 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.220486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4w7\" (UniqueName: \"kubernetes.io/projected/be89fdbf-23cf-435b-a974-0b99ccfb8715-kube-api-access-2k4w7\") pod \"kserve-controller-manager-69fc866d76-wq2cq\" (UID: \"be89fdbf-23cf-435b-a974-0b99ccfb8715\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.220689 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.220557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be89fdbf-23cf-435b-a974-0b99ccfb8715-cert\") pod \"kserve-controller-manager-69fc866d76-wq2cq\" (UID: \"be89fdbf-23cf-435b-a974-0b99ccfb8715\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.220689 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.220577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbb1f14-e919-4718-9ed3-97f5b2e18186-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vr7wg\" (UID: \"8cbb1f14-e919-4718-9ed3-97f5b2e18186\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.220689 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.220603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87np\" (UniqueName: \"kubernetes.io/projected/8cbb1f14-e919-4718-9ed3-97f5b2e18186-kube-api-access-p87np\") pod \"llmisvc-controller-manager-864bfd7bc9-vr7wg\" (UID: \"8cbb1f14-e919-4718-9ed3-97f5b2e18186\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.223058 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.223032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbb1f14-e919-4718-9ed3-97f5b2e18186-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-vr7wg\" (UID: \"8cbb1f14-e919-4718-9ed3-97f5b2e18186\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.223174 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.223120 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be89fdbf-23cf-435b-a974-0b99ccfb8715-cert\") pod \"kserve-controller-manager-69fc866d76-wq2cq\" (UID: \"be89fdbf-23cf-435b-a974-0b99ccfb8715\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.226938 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.226917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:38.273156 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.273137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4w7\" (UniqueName: \"kubernetes.io/projected/be89fdbf-23cf-435b-a974-0b99ccfb8715-kube-api-access-2k4w7\") pod \"kserve-controller-manager-69fc866d76-wq2cq\" (UID: \"be89fdbf-23cf-435b-a974-0b99ccfb8715\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.273413 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.273392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87np\" (UniqueName: \"kubernetes.io/projected/8cbb1f14-e919-4718-9ed3-97f5b2e18186-kube-api-access-p87np\") pod \"llmisvc-controller-manager-864bfd7bc9-vr7wg\" (UID: \"8cbb1f14-e919-4718-9ed3-97f5b2e18186\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.302134 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.301239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:38.312488 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.312468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:38.650721 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:38.650691 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8cbb1f14_e919_4718_9ed3_97f5b2e18186.slice/crio-7c20dd15610f9b5df3a6f3537ae2739dbf22021828c4cb349328b224dcdfcc24 WatchSource:0}: Error finding container 7c20dd15610f9b5df3a6f3537ae2739dbf22021828c4cb349328b224dcdfcc24: Status 404 returned error can't find the container with id 7c20dd15610f9b5df3a6f3537ae2739dbf22021828c4cb349328b224dcdfcc24 Jun 05 13:10:38.704828 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.704803 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wq2cq"] Jun 05 13:10:38.709505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.709480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:38.711421 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.711402 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg"] Jun 05 13:10:38.716335 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:38.716312 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe89fdbf_23cf_435b_a974_0b99ccfb8715.slice/crio-f0165fb40553197aea2ad8207e4a318b485e666ea9cad0c9934aa42396d5f1e0 WatchSource:0}: Error finding container f0165fb40553197aea2ad8207e4a318b485e666ea9cad0c9934aa42396d5f1e0: Status 404 returned error can't find the container with id f0165fb40553197aea2ad8207e4a318b485e666ea9cad0c9934aa42396d5f1e0 Jun 05 13:10:38.842481 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.842450 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c86895c8-qdx4z"] Jun 05 13:10:38.846038 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.846018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.926695 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926622 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-service-ca\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.926695 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-config\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.927084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7gn\" (UniqueName: \"kubernetes.io/projected/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-kube-api-access-5b7gn\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.927084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926826 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-serving-cert\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.927084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-oauth-config\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.927084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-trusted-ca-bundle\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.927084 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.926938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-oauth-serving-cert\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:38.948120 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.948082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" event={"ID":"8cbb1f14-e919-4718-9ed3-97f5b2e18186","Type":"ContainerStarted","Data":"7c20dd15610f9b5df3a6f3537ae2739dbf22021828c4cb349328b224dcdfcc24"} Jun 05 13:10:38.950132 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.950094 2558 generic.go:356] "Generic (PLEG): container finished" podID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerID="2105bd6aee689953d04c45bf143b5424ff550f78de0871309481e5bed1610b2a" exitCode=0 Jun 05 13:10:38.950271 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.950182 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" event={"ID":"a07ed249-1f07-4a80-bca5-9836cad008b8","Type":"ContainerDied","Data":"2105bd6aee689953d04c45bf143b5424ff550f78de0871309481e5bed1610b2a"} Jun 05 13:10:38.951216 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:38.951196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" event={"ID":"be89fdbf-23cf-435b-a974-0b99ccfb8715","Type":"ContainerStarted","Data":"f0165fb40553197aea2ad8207e4a318b485e666ea9cad0c9934aa42396d5f1e0"} Jun 05 13:10:39.027977 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.027954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-serving-cert\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028134 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-oauth-config\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028134 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-trusted-ca-bundle\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028134 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-oauth-serving-cert\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028301 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-service-ca\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028301 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-config\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028301 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7gn\" (UniqueName: \"kubernetes.io/projected/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-kube-api-access-5b7gn\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.028999 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-config\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.029080 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028995 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-trusted-ca-bundle\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.029080 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.028976 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-oauth-serving-cert\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.029080 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.029034 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-service-ca\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.030656 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.030631 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-serving-cert\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.030741 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.030661 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-console-oauth-config\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.071263 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.071243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7gn\" (UniqueName: \"kubernetes.io/projected/b2839cb8-ba95-4c5b-91a0-65ef51c64c9a-kube-api-access-5b7gn\") pod \"console-9c86895c8-qdx4z\" (UID: \"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a\") " pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.075361 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.075341 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c86895c8-qdx4z"] Jun 05 13:10:39.155405 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.155386 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:39.214766 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.214732 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:39.377470 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.377445 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c86895c8-qdx4z"] Jun 05 13:10:39.419270 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:39.419239 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2839cb8_ba95_4c5b_91a0_65ef51c64c9a.slice/crio-c9642e9df34c5f4a5bc87b5dcec9c477ee07a3c544d4d26975a6b23f068ce419 WatchSource:0}: Error finding container c9642e9df34c5f4a5bc87b5dcec9c477ee07a3c544d4d26975a6b23f068ce419: Status 404 returned error can't find the container with id c9642e9df34c5f4a5bc87b5dcec9c477ee07a3c544d4d26975a6b23f068ce419 Jun 05 13:10:39.557806 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.557768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:39.964580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.964534 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c86895c8-qdx4z" event={"ID":"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a","Type":"ContainerStarted","Data":"332980f189e4e2c88e798dbe168960fe305493dd0b6c29f61e34f20fbb582bbf"} Jun 05 13:10:39.965140 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:39.964595 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c86895c8-qdx4z" event={"ID":"b2839cb8-ba95-4c5b-91a0-65ef51c64c9a","Type":"ContainerStarted","Data":"c9642e9df34c5f4a5bc87b5dcec9c477ee07a3c544d4d26975a6b23f068ce419"} Jun 05 13:10:40.032601 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.032538 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9c86895c8-qdx4z" podStartSLOduration=2.032516484 podStartE2EDuration="2.032516484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:40.030591034 +0000 UTC m=+574.722104048" watchObservedRunningTime="2026-06-05 13:10:40.032516484 +0000 UTC m=+574.724029475" Jun 05 13:10:40.135120 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.135082 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:40.238708 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.238631 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shndh\" (UniqueName: \"kubernetes.io/projected/a07ed249-1f07-4a80-bca5-9836cad008b8-kube-api-access-shndh\") pod \"a07ed249-1f07-4a80-bca5-9836cad008b8\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " Jun 05 13:10:40.238708 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.238682 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-util\") pod \"a07ed249-1f07-4a80-bca5-9836cad008b8\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " Jun 05 13:10:40.238929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.238740 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-bundle\") pod \"a07ed249-1f07-4a80-bca5-9836cad008b8\" (UID: \"a07ed249-1f07-4a80-bca5-9836cad008b8\") " Jun 05 13:10:40.240369 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.240319 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-bundle" (OuterVolumeSpecName: "bundle") pod "a07ed249-1f07-4a80-bca5-9836cad008b8" (UID: "a07ed249-1f07-4a80-bca5-9836cad008b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:10:40.244124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.243260 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07ed249-1f07-4a80-bca5-9836cad008b8-kube-api-access-shndh" (OuterVolumeSpecName: "kube-api-access-shndh") pod "a07ed249-1f07-4a80-bca5-9836cad008b8" (UID: "a07ed249-1f07-4a80-bca5-9836cad008b8"). InnerVolumeSpecName "kube-api-access-shndh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:10:40.247550 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.247520 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-util" (OuterVolumeSpecName: "util") pod "a07ed249-1f07-4a80-bca5-9836cad008b8" (UID: "a07ed249-1f07-4a80-bca5-9836cad008b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:10:40.340342 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.340314 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shndh\" (UniqueName: \"kubernetes.io/projected/a07ed249-1f07-4a80-bca5-9836cad008b8-kube-api-access-shndh\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:10:40.340342 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.340341 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:10:40.340517 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.340355 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07ed249-1f07-4a80-bca5-9836cad008b8-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:10:40.411662 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.411630 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:40.884629 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.884594 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:40.973474 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.973430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" event={"ID":"a07ed249-1f07-4a80-bca5-9836cad008b8","Type":"ContainerDied","Data":"4792971da1da4f2c614532acf5c74cdb1d7c4da72095cc79ef3d684d33d6f645"} Jun 05 13:10:40.973841 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.973495 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4792971da1da4f2c614532acf5c74cdb1d7c4da72095cc79ef3d684d33d6f645" Jun 05 13:10:40.973841 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:40.973578 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agz22k" Jun 05 13:10:41.156721 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:41.156633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:41.473159 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:41.473131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:42.985005 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:42.984945 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" event={"ID":"be89fdbf-23cf-435b-a974-0b99ccfb8715","Type":"ContainerStarted","Data":"2d581d78a707bdd5e520c41fa9afbfbea4d6aaa44a320abb9a471b5be75bab7f"} Jun 05 13:10:42.985488 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:42.985011 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:10:42.986713 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:42.986690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" event={"ID":"8cbb1f14-e919-4718-9ed3-97f5b2e18186","Type":"ContainerStarted","Data":"7ce0803d2ca3d9a0f1ac270e675c9d79637aaee356339ee8e7764ec33ccfd27d"} Jun 05 13:10:42.986835 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:42.986822 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:10:43.193317 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:43.193267 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" podStartSLOduration=2.7683610549999997 podStartE2EDuration="6.193252744s" totalImagesPullingTime="3.424891689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:43.192391415 +0000 UTC m=+577.883904391" watchObservedRunningTime="2026-06-05 13:10:43.193252744 +0000 UTC m=+577.884765719" Jun 05 13:10:43.193923 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:43.193897 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" podStartSLOduration=2.838549342 podStartE2EDuration="6.193888219s" totalImagesPullingTime="3.355338877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:43.069004838 +0000 UTC m=+577.760517813" watchObservedRunningTime="2026-06-05 13:10:43.193888219 +0000 UTC m=+577.885401193" Jun 05 13:10:49.156460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:49.156419 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:49.156852 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:49.156488 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:49.161137 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:49.161088 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:50.023214 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:50.023186 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9c86895c8-qdx4z" Jun 05 13:10:50.184398 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:50.184366 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468786547-g7stf"] Jun 05 13:10:50.640482 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:50.640445 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:50.934682 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:50.934592 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:52.366175 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366144 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx"] Jun 05 13:10:52.366558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366488 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="pull" Jun 05 13:10:52.366558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366498 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="pull" Jun 05 13:10:52.366558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366511 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="util" Jun 05 13:10:52.366558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366517 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="util" Jun 05 13:10:52.366558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366529 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="extract" Jun 05 13:10:52.366558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366535 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="extract" Jun 05 13:10:52.366767 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.366593 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07ed249-1f07-4a80-bca5-9836cad008b8" containerName="extract" Jun 05 13:10:52.370685 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.370669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.377236 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.377213 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 13:10:52.377377 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.377338 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-wv2zr\"" Jun 05 13:10:52.377639 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.377617 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 13:10:52.443260 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.443225 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx"] Jun 05 13:10:52.545916 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.545886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/da0ac1da-40fd-4341-bc4e-dfd333bee5ef-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c8hmx\" (UID: \"da0ac1da-40fd-4341-bc4e-dfd333bee5ef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.546086 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.545975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcs9\" (UniqueName: \"kubernetes.io/projected/da0ac1da-40fd-4341-bc4e-dfd333bee5ef-kube-api-access-qdcs9\") pod \"servicemesh-operator3-57f65f65fb-c8hmx\" (UID: \"da0ac1da-40fd-4341-bc4e-dfd333bee5ef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.647111 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.647021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcs9\" (UniqueName: \"kubernetes.io/projected/da0ac1da-40fd-4341-bc4e-dfd333bee5ef-kube-api-access-qdcs9\") pod \"servicemesh-operator3-57f65f65fb-c8hmx\" (UID: \"da0ac1da-40fd-4341-bc4e-dfd333bee5ef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.647264 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.647091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/da0ac1da-40fd-4341-bc4e-dfd333bee5ef-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c8hmx\" (UID: \"da0ac1da-40fd-4341-bc4e-dfd333bee5ef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.649574 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.649555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/da0ac1da-40fd-4341-bc4e-dfd333bee5ef-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c8hmx\" (UID: \"da0ac1da-40fd-4341-bc4e-dfd333bee5ef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.676929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.676899 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcs9\" (UniqueName: \"kubernetes.io/projected/da0ac1da-40fd-4341-bc4e-dfd333bee5ef-kube-api-access-qdcs9\") pod \"servicemesh-operator3-57f65f65fb-c8hmx\" (UID: \"da0ac1da-40fd-4341-bc4e-dfd333bee5ef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.679793 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.679756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:52.934603 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:52.934580 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx"] Jun 05 13:10:52.937203 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:52.937173 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0ac1da_40fd_4341_bc4e_dfd333bee5ef.slice/crio-1f581e9bb0743509ca74052f0b7c1493096db9a365cede3fed0111d3d9b7f4a8 WatchSource:0}: Error finding container 1f581e9bb0743509ca74052f0b7c1493096db9a365cede3fed0111d3d9b7f4a8: Status 404 returned error can't find the container with id 1f581e9bb0743509ca74052f0b7c1493096db9a365cede3fed0111d3d9b7f4a8 Jun 05 13:10:53.038135 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:53.038091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" event={"ID":"da0ac1da-40fd-4341-bc4e-dfd333bee5ef","Type":"ContainerStarted","Data":"1f581e9bb0743509ca74052f0b7c1493096db9a365cede3fed0111d3d9b7f4a8"} Jun 05 13:10:54.146946 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.146915 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-69fcb86bc6-xpbxt"] Jun 05 13:10:54.150725 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.150688 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.155363 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.155342 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 13:10:54.155512 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.155495 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p6gwr\"" Jun 05 13:10:54.171792 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.171764 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:10:54.255893 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.255842 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69fcb86bc6-xpbxt"] Jun 05 13:10:54.261240 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.261214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9f245205-3553-4189-ab31-216d0d7b02e9-redirect-config\") pod \"dashboard-redirect-69fcb86bc6-xpbxt\" (UID: \"9f245205-3553-4189-ab31-216d0d7b02e9\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.261386 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.261287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4mn\" (UniqueName: \"kubernetes.io/projected/9f245205-3553-4189-ab31-216d0d7b02e9-kube-api-access-zc4mn\") pod \"dashboard-redirect-69fcb86bc6-xpbxt\" (UID: \"9f245205-3553-4189-ab31-216d0d7b02e9\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.361824 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.361783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9f245205-3553-4189-ab31-216d0d7b02e9-redirect-config\") pod \"dashboard-redirect-69fcb86bc6-xpbxt\" (UID: \"9f245205-3553-4189-ab31-216d0d7b02e9\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.362010 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.361856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4mn\" (UniqueName: \"kubernetes.io/projected/9f245205-3553-4189-ab31-216d0d7b02e9-kube-api-access-zc4mn\") pod \"dashboard-redirect-69fcb86bc6-xpbxt\" (UID: \"9f245205-3553-4189-ab31-216d0d7b02e9\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.362638 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.362615 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9f245205-3553-4189-ab31-216d0d7b02e9-redirect-config\") pod \"dashboard-redirect-69fcb86bc6-xpbxt\" (UID: \"9f245205-3553-4189-ab31-216d0d7b02e9\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.400564 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.400494 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4mn\" (UniqueName: \"kubernetes.io/projected/9f245205-3553-4189-ab31-216d0d7b02e9-kube-api-access-zc4mn\") pod \"dashboard-redirect-69fcb86bc6-xpbxt\" (UID: \"9f245205-3553-4189-ab31-216d0d7b02e9\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.464167 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.464135 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" Jun 05 13:10:54.648820 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:54.648776 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69fcb86bc6-xpbxt"] Jun 05 13:10:55.649406 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:10:55.649373 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f245205_3553_4189_ab31_216d0d7b02e9.slice/crio-b1a39a728d1b23bc38a184d30346a0a1d39d1c1c74ce6ed8e881e4f1cd43c709 WatchSource:0}: Error finding container b1a39a728d1b23bc38a184d30346a0a1d39d1c1c74ce6ed8e881e4f1cd43c709: Status 404 returned error can't find the container with id b1a39a728d1b23bc38a184d30346a0a1d39d1c1c74ce6ed8e881e4f1cd43c709 Jun 05 13:10:56.057420 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:56.057391 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" event={"ID":"9f245205-3553-4189-ab31-216d0d7b02e9","Type":"ContainerStarted","Data":"b1a39a728d1b23bc38a184d30346a0a1d39d1c1c74ce6ed8e881e4f1cd43c709"} Jun 05 13:10:57.068757 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:57.068724 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" event={"ID":"da0ac1da-40fd-4341-bc4e-dfd333bee5ef","Type":"ContainerStarted","Data":"5573166b3f0504348e1f9191a040f71b77d57a98d00dbb6e11d4d917bf95cef4"} Jun 05 13:10:57.069212 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:57.068910 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:10:57.132415 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:57.132366 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" podStartSLOduration=2.104766068 podStartE2EDuration="5.132349994s" totalImagesPullingTime="3.027583926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:57.130185597 +0000 UTC m=+591.821698572" watchObservedRunningTime="2026-06-05 13:10:57.132349994 +0000 UTC m=+591.823862968" Jun 05 13:10:59.080609 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:59.080570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" event={"ID":"9f245205-3553-4189-ab31-216d0d7b02e9","Type":"ContainerStarted","Data":"163ad4a2a03c77e36201ed167061755af32fe60aecbd3712fd66093e7ceaf6da"} Jun 05 13:10:59.130575 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:10:59.130523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-69fcb86bc6-xpbxt" podStartSLOduration=2.270629052 podStartE2EDuration="5.130504595s" totalImagesPullingTime="2.859875543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:59.128077782 +0000 UTC m=+593.819590756" watchObservedRunningTime="2026-06-05 13:10:59.130504595 +0000 UTC m=+593.822017570" Jun 05 13:11:01.420038 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:01.420000 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:01.573760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:01.573724 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:05.761616 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:05.761584 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:11:05.762082 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:05.761621 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:11:08.076299 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:08.076272 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c8hmx" Jun 05 13:11:13.993426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:13.993391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-vr7wg" Jun 05 13:11:13.997027 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:13.997007 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-wq2cq" Jun 05 13:11:15.203206 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.203154 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8468786547-g7stf" podUID="bacbe249-75be-464e-849a-a822c62cf387" containerName="console" containerID="cri-o://9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e" gracePeriod=15 Jun 05 13:11:15.449900 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.449877 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:11:15.550584 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550553 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-service-ca\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.550746 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550603 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-console-config\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.550746 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550627 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-trusted-ca-bundle\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.550845 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550745 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-oauth-config\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.550845 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550800 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-oauth-serving-cert\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.550953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550876 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27c8c\" (UniqueName: \"kubernetes.io/projected/bacbe249-75be-464e-849a-a822c62cf387-kube-api-access-27c8c\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.550953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.550904 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-serving-cert\") pod \"bacbe249-75be-464e-849a-a822c62cf387\" (UID: \"bacbe249-75be-464e-849a-a822c62cf387\") " Jun 05 13:11:15.551166 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551055 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-console-config" (OuterVolumeSpecName: "console-config") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:15.551166 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551113 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-service-ca" (OuterVolumeSpecName: "service-ca") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:15.551166 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551121 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:15.551424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551237 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-service-ca\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:15.551424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551252 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-console-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:15.551424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551264 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-trusted-ca-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:15.551424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.551289 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:15.552954 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.552920 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:15.553058 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.552952 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:15.553129 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.553073 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bacbe249-75be-464e-849a-a822c62cf387-kube-api-access-27c8c" (OuterVolumeSpecName: "kube-api-access-27c8c") pod "bacbe249-75be-464e-849a-a822c62cf387" (UID: "bacbe249-75be-464e-849a-a822c62cf387"). InnerVolumeSpecName "kube-api-access-27c8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:15.652197 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.652158 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-oauth-config\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:15.652197 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.652187 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacbe249-75be-464e-849a-a822c62cf387-oauth-serving-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:15.652197 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.652197 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27c8c\" (UniqueName: \"kubernetes.io/projected/bacbe249-75be-464e-849a-a822c62cf387-kube-api-access-27c8c\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:15.652197 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:15.652208 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacbe249-75be-464e-849a-a822c62cf387-console-serving-cert\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:16.174827 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.174794 2558 generic.go:356] "Generic (PLEG): container finished" podID="bacbe249-75be-464e-849a-a822c62cf387" containerID="9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e" exitCode=0 Jun 05 13:11:16.175003 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.174836 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468786547-g7stf" Jun 05 13:11:16.175003 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.174872 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468786547-g7stf" event={"ID":"bacbe249-75be-464e-849a-a822c62cf387","Type":"ContainerDied","Data":"9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e"} Jun 05 13:11:16.175003 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.174919 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468786547-g7stf" event={"ID":"bacbe249-75be-464e-849a-a822c62cf387","Type":"ContainerDied","Data":"265cdba87c9817c6f9b4908d9bb731e3832c20cf79fb7bccd17ee54afc2f3c9d"} Jun 05 13:11:16.175003 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.174938 2558 scope.go:117] "RemoveContainer" containerID="9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e" Jun 05 13:11:16.183652 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.183635 2558 scope.go:117] "RemoveContainer" containerID="9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e" Jun 05 13:11:16.183898 ip-10-0-132-150 kubenswrapper[2558]: E0605 13:11:16.183880 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e\": container with ID starting with 9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e not found: ID does not exist" containerID="9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e" Jun 05 13:11:16.183942 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.183905 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e"} err="failed to get container status \"9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e\": rpc error: code = NotFound desc = could not find container \"9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e\": container with ID starting with 9d4d8af80ed1a0888cce91f7333fadb27d6e9226ebb64a9040b563657a1a3c1e not found: ID does not exist" Jun 05 13:11:16.203293 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.203272 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468786547-g7stf"] Jun 05 13:11:16.214276 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.214251 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8468786547-g7stf"] Jun 05 13:11:16.380298 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:16.380267 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:17.689678 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.689639 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:17.765443 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.765411 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bacbe249-75be-464e-849a-a822c62cf387" path="/var/lib/kubelet/pods/bacbe249-75be-464e-849a-a822c62cf387/volumes" Jun 05 13:11:17.839238 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.839207 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmmp6"] Jun 05 13:11:17.839585 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.839574 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bacbe249-75be-464e-849a-a822c62cf387" containerName="console" Jun 05 13:11:17.839630 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.839587 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bacbe249-75be-464e-849a-a822c62cf387" containerName="console" Jun 05 13:11:17.839674 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.839665 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bacbe249-75be-464e-849a-a822c62cf387" containerName="console" Jun 05 13:11:17.842492 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.842475 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:17.848631 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.848607 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6n4b7\"" Jun 05 13:11:17.850263 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.850245 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 13:11:17.854961 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.854945 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 13:11:17.888572 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.888539 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmmp6"] Jun 05 13:11:17.970294 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:17.970248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gl8x\" (UniqueName: \"kubernetes.io/projected/25f806c8-fac5-4550-9272-ef6277a263e2-kube-api-access-2gl8x\") pod \"kuadrant-operator-catalog-mmmp6\" (UID: \"25f806c8-fac5-4550-9272-ef6277a263e2\") " pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:18.033733 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.033686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:18.071580 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.071529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gl8x\" (UniqueName: \"kubernetes.io/projected/25f806c8-fac5-4550-9272-ef6277a263e2-kube-api-access-2gl8x\") pod \"kuadrant-operator-catalog-mmmp6\" (UID: \"25f806c8-fac5-4550-9272-ef6277a263e2\") " pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:18.097215 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.097188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gl8x\" (UniqueName: \"kubernetes.io/projected/25f806c8-fac5-4550-9272-ef6277a263e2-kube-api-access-2gl8x\") pod \"kuadrant-operator-catalog-mmmp6\" (UID: \"25f806c8-fac5-4550-9272-ef6277a263e2\") " pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:18.152182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.152146 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:18.223324 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.223230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:18.307707 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.307683 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmmp6"] Jun 05 13:11:18.310298 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:18.310266 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f806c8_fac5_4550_9272_ef6277a263e2.slice/crio-3f2444cf06121c926c999afeb5728f9947621003dd7c85860c451a8613df0a03 WatchSource:0}: Error finding container 3f2444cf06121c926c999afeb5728f9947621003dd7c85860c451a8613df0a03: Status 404 returned error can't find the container with id 3f2444cf06121c926c999afeb5728f9947621003dd7c85860c451a8613df0a03 Jun 05 13:11:18.550598 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:18.550504 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:19.192728 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:19.192688 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" event={"ID":"25f806c8-fac5-4550-9272-ef6277a263e2","Type":"ContainerStarted","Data":"3f2444cf06121c926c999afeb5728f9947621003dd7c85860c451a8613df0a03"} Jun 05 13:11:21.205514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:21.205483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" event={"ID":"25f806c8-fac5-4550-9272-ef6277a263e2","Type":"ContainerStarted","Data":"b24f6724a767961796e9c4a93ffd58f565b1249f2e618468ceeb60e083a96443"} Jun 05 13:11:28.152977 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:28.152881 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:28.152977 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:28.152958 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:28.175250 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:28.175224 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:28.207794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:28.207655 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" podStartSLOduration=8.76339597 podStartE2EDuration="11.207612749s" totalImagesPullingTime="2.444216779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:11:21.238012836 +0000 UTC m=+615.929525805" watchObservedRunningTime="2026-06-05 13:11:28.207612749 +0000 UTC m=+622.899125722" Jun 05 13:11:28.263476 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:28.263453 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mmmp6" Jun 05 13:11:32.604894 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.604857 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d"] Jun 05 13:11:32.616845 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.616821 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.620247 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.620227 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fj5pc\"" Jun 05 13:11:32.641505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.641478 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d"] Jun 05 13:11:32.698953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.698916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.699165 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.698970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.699165 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.699050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfdg2\" (UniqueName: \"kubernetes.io/projected/ef605fda-be23-4d22-a155-e7b8b0a67ea3-kube-api-access-dfdg2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.800183 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.800146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.800364 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.800207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfdg2\" (UniqueName: \"kubernetes.io/projected/ef605fda-be23-4d22-a155-e7b8b0a67ea3-kube-api-access-dfdg2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.800364 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.800274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.800617 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.800592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.800655 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.800606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.814508 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.814479 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfdg2\" (UniqueName: \"kubernetes.io/projected/ef605fda-be23-4d22-a155-e7b8b0a67ea3-kube-api-access-dfdg2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.922669 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.922597 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz"] Jun 05 13:11:32.925231 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.925216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:32.926138 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.926122 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:32.948690 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:32.948617 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz"] Jun 05 13:11:33.075646 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.075622 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d"] Jun 05 13:11:33.077028 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:33.076992 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef605fda_be23_4d22_a155_e7b8b0a67ea3.slice/crio-e4092b99dec17bfb3286771e0859ad7f4f4cf3917b2f4b724b4c83395dc6ea05 WatchSource:0}: Error finding container e4092b99dec17bfb3286771e0859ad7f4f4cf3917b2f4b724b4c83395dc6ea05: Status 404 returned error can't find the container with id e4092b99dec17bfb3286771e0859ad7f4f4cf3917b2f4b724b4c83395dc6ea05 Jun 05 13:11:33.103198 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.103172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zl25\" (UniqueName: \"kubernetes.io/projected/a80929a5-063c-4aa0-9315-458f235d1445-kube-api-access-4zl25\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.103306 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.103219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.103306 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.103238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.204153 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.204125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zl25\" (UniqueName: \"kubernetes.io/projected/a80929a5-063c-4aa0-9315-458f235d1445-kube-api-access-4zl25\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.204276 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.204185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.204276 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.204213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.204581 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.204558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.204581 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.204572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.219225 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.219204 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zl25\" (UniqueName: \"kubernetes.io/projected/a80929a5-063c-4aa0-9315-458f235d1445-kube-api-access-4zl25\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.234712 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.234687 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:33.270284 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.270253 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerID="974220a1ed88817caaffef7906484b4825fedac1b55cb9580dc2ea4d2005297c" exitCode=0 Jun 05 13:11:33.270425 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.270343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" event={"ID":"ef605fda-be23-4d22-a155-e7b8b0a67ea3","Type":"ContainerDied","Data":"974220a1ed88817caaffef7906484b4825fedac1b55cb9580dc2ea4d2005297c"} Jun 05 13:11:33.270425 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.270400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" event={"ID":"ef605fda-be23-4d22-a155-e7b8b0a67ea3","Type":"ContainerStarted","Data":"e4092b99dec17bfb3286771e0859ad7f4f4cf3917b2f4b724b4c83395dc6ea05"} Jun 05 13:11:33.361814 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.361781 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r"] Jun 05 13:11:33.365541 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.365518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.379537 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.379516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz"] Jun 05 13:11:33.380690 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:33.380667 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80929a5_063c_4aa0_9315_458f235d1445.slice/crio-de5545bc9321c8ec917935c946ca62991a1fda0c365c84744f41db6e7c65fa61 WatchSource:0}: Error finding container de5545bc9321c8ec917935c946ca62991a1fda0c365c84744f41db6e7c65fa61: Status 404 returned error can't find the container with id de5545bc9321c8ec917935c946ca62991a1fda0c365c84744f41db6e7c65fa61 Jun 05 13:11:33.392064 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.391805 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r"] Jun 05 13:11:33.507226 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.507193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stdgc\" (UniqueName: \"kubernetes.io/projected/5f1c295a-6281-44ad-971d-0bf56a5bddcb-kube-api-access-stdgc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.507354 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.507248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.507354 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.507302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.608682 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.608645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stdgc\" (UniqueName: \"kubernetes.io/projected/5f1c295a-6281-44ad-971d-0bf56a5bddcb-kube-api-access-stdgc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.609163 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.608702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.609163 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.608734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.609163 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.609047 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.609352 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.609089 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.619604 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.619577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stdgc\" (UniqueName: \"kubernetes.io/projected/5f1c295a-6281-44ad-971d-0bf56a5bddcb-kube-api-access-stdgc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.674955 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.674924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:33.704658 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.704630 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p"] Jun 05 13:11:33.707440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.707424 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.731834 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.731807 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p"] Jun 05 13:11:33.810576 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.810537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.810576 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.810579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thrdm\" (UniqueName: \"kubernetes.io/projected/dbc48bd7-0758-43ed-94be-3e01c6082839-kube-api-access-thrdm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.810824 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.810634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.820760 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.820724 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r"] Jun 05 13:11:33.822401 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:33.822372 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1c295a_6281_44ad_971d_0bf56a5bddcb.slice/crio-24d61304feb1622f0ff661ece6940c2a4c465c0e18ab8a2d5faa3eef31a90570 WatchSource:0}: Error finding container 24d61304feb1622f0ff661ece6940c2a4c465c0e18ab8a2d5faa3eef31a90570: Status 404 returned error can't find the container with id 24d61304feb1622f0ff661ece6940c2a4c465c0e18ab8a2d5faa3eef31a90570 Jun 05 13:11:33.911761 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.911724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.911906 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.911884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.911987 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.911926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thrdm\" (UniqueName: \"kubernetes.io/projected/dbc48bd7-0758-43ed-94be-3e01c6082839-kube-api-access-thrdm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.912164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.912137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.912329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.912198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:33.929879 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:33.929846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thrdm\" (UniqueName: \"kubernetes.io/projected/dbc48bd7-0758-43ed-94be-3e01c6082839-kube-api-access-thrdm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:34.017594 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.017525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:34.211767 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.211740 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p"] Jun 05 13:11:34.223147 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:34.223093 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc48bd7_0758_43ed_94be_3e01c6082839.slice/crio-8cd418a460179a3aae4afc7bc6cf5b7631160ab9eef4528ce9531f9ea9569a48 WatchSource:0}: Error finding container 8cd418a460179a3aae4afc7bc6cf5b7631160ab9eef4528ce9531f9ea9569a48: Status 404 returned error can't find the container with id 8cd418a460179a3aae4afc7bc6cf5b7631160ab9eef4528ce9531f9ea9569a48 Jun 05 13:11:34.277198 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.277168 2558 generic.go:356] "Generic (PLEG): container finished" podID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerID="d8c90e4caa79223f218a920ab7f63fbf26361214dfaa1cf0a30cd88ce0d12c1c" exitCode=0 Jun 05 13:11:34.277328 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.277213 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" event={"ID":"5f1c295a-6281-44ad-971d-0bf56a5bddcb","Type":"ContainerDied","Data":"d8c90e4caa79223f218a920ab7f63fbf26361214dfaa1cf0a30cd88ce0d12c1c"} Jun 05 13:11:34.277328 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.277267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" event={"ID":"5f1c295a-6281-44ad-971d-0bf56a5bddcb","Type":"ContainerStarted","Data":"24d61304feb1622f0ff661ece6940c2a4c465c0e18ab8a2d5faa3eef31a90570"} Jun 05 13:11:34.278953 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.278924 2558 generic.go:356] "Generic (PLEG): container finished" podID="a80929a5-063c-4aa0-9315-458f235d1445" containerID="b3aa62a040538086e1da01f9191463b1f6b10f34a025da23970fa194978f7ce9" exitCode=0 Jun 05 13:11:34.279055 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.279015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" event={"ID":"a80929a5-063c-4aa0-9315-458f235d1445","Type":"ContainerDied","Data":"b3aa62a040538086e1da01f9191463b1f6b10f34a025da23970fa194978f7ce9"} Jun 05 13:11:34.279137 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.279059 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" event={"ID":"a80929a5-063c-4aa0-9315-458f235d1445","Type":"ContainerStarted","Data":"de5545bc9321c8ec917935c946ca62991a1fda0c365c84744f41db6e7c65fa61"} Jun 05 13:11:34.280403 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.280378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" event={"ID":"dbc48bd7-0758-43ed-94be-3e01c6082839","Type":"ContainerStarted","Data":"8cd418a460179a3aae4afc7bc6cf5b7631160ab9eef4528ce9531f9ea9569a48"} Jun 05 13:11:34.282548 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.282527 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerID="600551c405357f799562b374056fd0e0c5997a660363799b5f0bb1848b65cde9" exitCode=0 Jun 05 13:11:34.282648 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:34.282557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" event={"ID":"ef605fda-be23-4d22-a155-e7b8b0a67ea3","Type":"ContainerDied","Data":"600551c405357f799562b374056fd0e0c5997a660363799b5f0bb1848b65cde9"} Jun 05 13:11:35.289248 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.289163 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerID="327b42dad9b8edc5fb3d0e69a85e2ec4e02eade4534c7a64dce37311185a37d0" exitCode=0 Jun 05 13:11:35.289673 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.289250 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" event={"ID":"dbc48bd7-0758-43ed-94be-3e01c6082839","Type":"ContainerDied","Data":"327b42dad9b8edc5fb3d0e69a85e2ec4e02eade4534c7a64dce37311185a37d0"} Jun 05 13:11:35.291808 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.291684 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerID="2f2c8daa6a8fcab9aaf96d908300fcea84f620b23da8693c8e3b8d27e91a9ce0" exitCode=0 Jun 05 13:11:35.291808 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.291769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" event={"ID":"ef605fda-be23-4d22-a155-e7b8b0a67ea3","Type":"ContainerDied","Data":"2f2c8daa6a8fcab9aaf96d908300fcea84f620b23da8693c8e3b8d27e91a9ce0"} Jun 05 13:11:35.293499 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.293481 2558 generic.go:356] "Generic (PLEG): container finished" podID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerID="1b0dc84b2f85799b1f22245a4592a182227eeee922718f2d06e70120a6e7fdc0" exitCode=0 Jun 05 13:11:35.293586 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.293558 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" event={"ID":"5f1c295a-6281-44ad-971d-0bf56a5bddcb","Type":"ContainerDied","Data":"1b0dc84b2f85799b1f22245a4592a182227eeee922718f2d06e70120a6e7fdc0"} Jun 05 13:11:35.295316 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.295299 2558 generic.go:356] "Generic (PLEG): container finished" podID="a80929a5-063c-4aa0-9315-458f235d1445" containerID="961821e634d0d99652c4d8f528f55b1f23d939c4971f3d2fc689939a4ed5cf64" exitCode=0 Jun 05 13:11:35.295397 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:35.295331 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" event={"ID":"a80929a5-063c-4aa0-9315-458f235d1445","Type":"ContainerDied","Data":"961821e634d0d99652c4d8f528f55b1f23d939c4971f3d2fc689939a4ed5cf64"} Jun 05 13:11:36.302998 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.302969 2558 generic.go:356] "Generic (PLEG): container finished" podID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerID="6e6fc593d929a80b5fc3ca75c1aeecbf2e4323e442c7d5c2632a31d12ba39c30" exitCode=0 Jun 05 13:11:36.303374 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.303047 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" event={"ID":"5f1c295a-6281-44ad-971d-0bf56a5bddcb","Type":"ContainerDied","Data":"6e6fc593d929a80b5fc3ca75c1aeecbf2e4323e442c7d5c2632a31d12ba39c30"} Jun 05 13:11:36.305316 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.305279 2558 generic.go:356] "Generic (PLEG): container finished" podID="a80929a5-063c-4aa0-9315-458f235d1445" containerID="85788f927ca39ceb1c9f7133707b1dc718982ae075224d4ca2e34e32275eedd2" exitCode=0 Jun 05 13:11:36.305426 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.305335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" event={"ID":"a80929a5-063c-4aa0-9315-458f235d1445","Type":"ContainerDied","Data":"85788f927ca39ceb1c9f7133707b1dc718982ae075224d4ca2e34e32275eedd2"} Jun 05 13:11:36.471748 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.471723 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:36.639647 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.639557 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-bundle\") pod \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " Jun 05 13:11:36.639647 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.639639 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfdg2\" (UniqueName: \"kubernetes.io/projected/ef605fda-be23-4d22-a155-e7b8b0a67ea3-kube-api-access-dfdg2\") pod \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " Jun 05 13:11:36.639873 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.639684 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-util\") pod \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\" (UID: \"ef605fda-be23-4d22-a155-e7b8b0a67ea3\") " Jun 05 13:11:36.640158 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.640124 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-bundle" (OuterVolumeSpecName: "bundle") pod "ef605fda-be23-4d22-a155-e7b8b0a67ea3" (UID: "ef605fda-be23-4d22-a155-e7b8b0a67ea3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:36.641820 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.641797 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef605fda-be23-4d22-a155-e7b8b0a67ea3-kube-api-access-dfdg2" (OuterVolumeSpecName: "kube-api-access-dfdg2") pod "ef605fda-be23-4d22-a155-e7b8b0a67ea3" (UID: "ef605fda-be23-4d22-a155-e7b8b0a67ea3"). InnerVolumeSpecName "kube-api-access-dfdg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:36.645138 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.645115 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-util" (OuterVolumeSpecName: "util") pod "ef605fda-be23-4d22-a155-e7b8b0a67ea3" (UID: "ef605fda-be23-4d22-a155-e7b8b0a67ea3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:36.741199 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.741166 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfdg2\" (UniqueName: \"kubernetes.io/projected/ef605fda-be23-4d22-a155-e7b8b0a67ea3-kube-api-access-dfdg2\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:36.741199 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.741192 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:36.741199 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:36.741203 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef605fda-be23-4d22-a155-e7b8b0a67ea3-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:37.313979 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.313946 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerID="2e307d48c6cd3a2c4ccedef34bcec0fca3730891db3be40a081da7b0a31a95b8" exitCode=0 Jun 05 13:11:37.314458 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.313984 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" event={"ID":"dbc48bd7-0758-43ed-94be-3e01c6082839","Type":"ContainerDied","Data":"2e307d48c6cd3a2c4ccedef34bcec0fca3730891db3be40a081da7b0a31a95b8"} Jun 05 13:11:37.316219 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.316200 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" Jun 05 13:11:37.316329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.316212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d" event={"ID":"ef605fda-be23-4d22-a155-e7b8b0a67ea3","Type":"ContainerDied","Data":"e4092b99dec17bfb3286771e0859ad7f4f4cf3917b2f4b724b4c83395dc6ea05"} Jun 05 13:11:37.316329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.316252 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4092b99dec17bfb3286771e0859ad7f4f4cf3917b2f4b724b4c83395dc6ea05" Jun 05 13:11:37.467464 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.467432 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:37.543983 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.543958 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:37.550672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.550648 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stdgc\" (UniqueName: \"kubernetes.io/projected/5f1c295a-6281-44ad-971d-0bf56a5bddcb-kube-api-access-stdgc\") pod \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " Jun 05 13:11:37.550672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.550680 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zl25\" (UniqueName: \"kubernetes.io/projected/a80929a5-063c-4aa0-9315-458f235d1445-kube-api-access-4zl25\") pod \"a80929a5-063c-4aa0-9315-458f235d1445\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " Jun 05 13:11:37.550846 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.550699 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-util\") pod \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " Jun 05 13:11:37.550846 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.550740 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-bundle\") pod \"a80929a5-063c-4aa0-9315-458f235d1445\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " Jun 05 13:11:37.550846 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.550778 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-util\") pod \"a80929a5-063c-4aa0-9315-458f235d1445\" (UID: \"a80929a5-063c-4aa0-9315-458f235d1445\") " Jun 05 13:11:37.550846 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.550828 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-bundle\") pod \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\" (UID: \"5f1c295a-6281-44ad-971d-0bf56a5bddcb\") " Jun 05 13:11:37.551403 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.551325 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-bundle" (OuterVolumeSpecName: "bundle") pod "a80929a5-063c-4aa0-9315-458f235d1445" (UID: "a80929a5-063c-4aa0-9315-458f235d1445"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:37.551513 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.551482 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-bundle" (OuterVolumeSpecName: "bundle") pod "5f1c295a-6281-44ad-971d-0bf56a5bddcb" (UID: "5f1c295a-6281-44ad-971d-0bf56a5bddcb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:37.552889 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.552868 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80929a5-063c-4aa0-9315-458f235d1445-kube-api-access-4zl25" (OuterVolumeSpecName: "kube-api-access-4zl25") pod "a80929a5-063c-4aa0-9315-458f235d1445" (UID: "a80929a5-063c-4aa0-9315-458f235d1445"). InnerVolumeSpecName "kube-api-access-4zl25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:37.553288 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.553275 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1c295a-6281-44ad-971d-0bf56a5bddcb-kube-api-access-stdgc" (OuterVolumeSpecName: "kube-api-access-stdgc") pod "5f1c295a-6281-44ad-971d-0bf56a5bddcb" (UID: "5f1c295a-6281-44ad-971d-0bf56a5bddcb"). InnerVolumeSpecName "kube-api-access-stdgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:37.557081 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.557055 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-util" (OuterVolumeSpecName: "util") pod "5f1c295a-6281-44ad-971d-0bf56a5bddcb" (UID: "5f1c295a-6281-44ad-971d-0bf56a5bddcb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:37.557203 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.557132 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-util" (OuterVolumeSpecName: "util") pod "a80929a5-063c-4aa0-9315-458f235d1445" (UID: "a80929a5-063c-4aa0-9315-458f235d1445"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:37.651547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.651455 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stdgc\" (UniqueName: \"kubernetes.io/projected/5f1c295a-6281-44ad-971d-0bf56a5bddcb-kube-api-access-stdgc\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:37.651547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.651488 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zl25\" (UniqueName: \"kubernetes.io/projected/a80929a5-063c-4aa0-9315-458f235d1445-kube-api-access-4zl25\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:37.651547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.651500 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:37.651547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.651510 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:37.651547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.651518 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a80929a5-063c-4aa0-9315-458f235d1445-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:37.651547 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:37.651525 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f1c295a-6281-44ad-971d-0bf56a5bddcb-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:38.330560 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.330527 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" event={"ID":"5f1c295a-6281-44ad-971d-0bf56a5bddcb","Type":"ContainerDied","Data":"24d61304feb1622f0ff661ece6940c2a4c465c0e18ab8a2d5faa3eef31a90570"} Jun 05 13:11:38.330988 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.330608 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24d61304feb1622f0ff661ece6940c2a4c465c0e18ab8a2d5faa3eef31a90570" Jun 05 13:11:38.330988 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.330538 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r" Jun 05 13:11:38.332725 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.332696 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" event={"ID":"a80929a5-063c-4aa0-9315-458f235d1445","Type":"ContainerDied","Data":"de5545bc9321c8ec917935c946ca62991a1fda0c365c84744f41db6e7c65fa61"} Jun 05 13:11:38.332878 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.332737 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de5545bc9321c8ec917935c946ca62991a1fda0c365c84744f41db6e7c65fa61" Jun 05 13:11:38.332878 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.332713 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz" Jun 05 13:11:38.338334 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.338308 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerID="f588ac43497ac50566d23e00adcae7789be251d1d7cd37abfffcd7327681ae95" exitCode=0 Jun 05 13:11:38.338462 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:38.338430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" event={"ID":"dbc48bd7-0758-43ed-94be-3e01c6082839","Type":"ContainerDied","Data":"f588ac43497ac50566d23e00adcae7789be251d1d7cd37abfffcd7327681ae95"} Jun 05 13:11:39.467460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.467436 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:39.564182 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.564149 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-bundle\") pod \"dbc48bd7-0758-43ed-94be-3e01c6082839\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " Jun 05 13:11:39.564348 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.564216 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-util\") pod \"dbc48bd7-0758-43ed-94be-3e01c6082839\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " Jun 05 13:11:39.564348 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.564235 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thrdm\" (UniqueName: \"kubernetes.io/projected/dbc48bd7-0758-43ed-94be-3e01c6082839-kube-api-access-thrdm\") pod \"dbc48bd7-0758-43ed-94be-3e01c6082839\" (UID: \"dbc48bd7-0758-43ed-94be-3e01c6082839\") " Jun 05 13:11:39.564729 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.564705 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-bundle" (OuterVolumeSpecName: "bundle") pod "dbc48bd7-0758-43ed-94be-3e01c6082839" (UID: "dbc48bd7-0758-43ed-94be-3e01c6082839"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:39.566414 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.566341 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc48bd7-0758-43ed-94be-3e01c6082839-kube-api-access-thrdm" (OuterVolumeSpecName: "kube-api-access-thrdm") pod "dbc48bd7-0758-43ed-94be-3e01c6082839" (UID: "dbc48bd7-0758-43ed-94be-3e01c6082839"). InnerVolumeSpecName "kube-api-access-thrdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:39.569312 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.569289 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-util" (OuterVolumeSpecName: "util") pod "dbc48bd7-0758-43ed-94be-3e01c6082839" (UID: "dbc48bd7-0758-43ed-94be-3e01c6082839"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:39.665015 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.664918 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:39.665015 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.664951 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc48bd7-0758-43ed-94be-3e01c6082839-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:39.665015 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:39.664967 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thrdm\" (UniqueName: \"kubernetes.io/projected/dbc48bd7-0758-43ed-94be-3e01c6082839-kube-api-access-thrdm\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:11:40.350970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:40.350938 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" Jun 05 13:11:40.350970 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:40.350958 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p" event={"ID":"dbc48bd7-0758-43ed-94be-3e01c6082839","Type":"ContainerDied","Data":"8cd418a460179a3aae4afc7bc6cf5b7631160ab9eef4528ce9531f9ea9569a48"} Jun 05 13:11:40.351206 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:40.351009 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cd418a460179a3aae4afc7bc6cf5b7631160ab9eef4528ce9531f9ea9569a48" Jun 05 13:11:46.103627 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:46.103589 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:46.924496 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:46.924458 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:47.274813 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:47.274779 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:50.354996 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.354958 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rzj95"] Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355364 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="pull" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355376 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="pull" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355388 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="util" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355394 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="util" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355400 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="extract" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355406 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="extract" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355415 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="util" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355420 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="util" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355430 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="pull" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355436 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="pull" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355445 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="util" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355450 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="util" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355455 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="extract" Jun 05 13:11:50.355449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355460 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355468 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="util" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355473 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="util" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355481 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="pull" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355485 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="pull" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355492 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355496 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355503 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355508 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355513 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="pull" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355518 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="pull" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355573 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc48bd7-0758-43ed-94be-3e01c6082839" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355582 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef605fda-be23-4d22-a155-e7b8b0a67ea3" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355590 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80929a5-063c-4aa0-9315-458f235d1445" containerName="extract" Jun 05 13:11:50.355973 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.355597 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1c295a-6281-44ad-971d-0bf56a5bddcb" containerName="extract" Jun 05 13:11:50.357985 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.357970 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:11:50.361515 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.361491 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f2npc\"" Jun 05 13:11:50.395458 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.395429 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rzj95"] Jun 05 13:11:50.462028 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.461989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zhn9\" (UniqueName: \"kubernetes.io/projected/3787b6e8-772d-4d30-b87a-61f403db5ec2-kube-api-access-6zhn9\") pod \"authorino-operator-75cc8d5cb7-rzj95\" (UID: \"3787b6e8-772d-4d30-b87a-61f403db5ec2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:11:50.563410 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.563369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zhn9\" (UniqueName: \"kubernetes.io/projected/3787b6e8-772d-4d30-b87a-61f403db5ec2-kube-api-access-6zhn9\") pod \"authorino-operator-75cc8d5cb7-rzj95\" (UID: \"3787b6e8-772d-4d30-b87a-61f403db5ec2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:11:50.578528 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.578493 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:50.593537 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.593508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zhn9\" (UniqueName: \"kubernetes.io/projected/3787b6e8-772d-4d30-b87a-61f403db5ec2-kube-api-access-6zhn9\") pod \"authorino-operator-75cc8d5cb7-rzj95\" (UID: \"3787b6e8-772d-4d30-b87a-61f403db5ec2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:11:50.609273 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.609196 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf"] Jun 05 13:11:50.611764 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.611748 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.614495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.614475 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 13:11:50.614820 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.614805 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 13:11:50.614896 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.614812 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 13:11:50.614896 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.614847 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 13:11:50.618330 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.618310 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qjzhm\"" Jun 05 13:11:50.659256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.659217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf"] Jun 05 13:11:50.664045 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.664212 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jdf\" (UniqueName: \"kubernetes.io/projected/9c402e6d-21d6-4264-8d06-d37f95611063-kube-api-access-75jdf\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.664212 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c402e6d-21d6-4264-8d06-d37f95611063-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.664212 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.664386 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c402e6d-21d6-4264-8d06-d37f95611063-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.664386 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.664386 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.664285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c402e6d-21d6-4264-8d06-d37f95611063-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.667849 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.667833 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:11:50.765006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.764974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c402e6d-21d6-4264-8d06-d37f95611063-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.765006 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.765015 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.765249 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.765049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c402e6d-21d6-4264-8d06-d37f95611063-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.765249 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.765123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.765249 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.765177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jdf\" (UniqueName: \"kubernetes.io/projected/9c402e6d-21d6-4264-8d06-d37f95611063-kube-api-access-75jdf\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.765249 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.765234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c402e6d-21d6-4264-8d06-d37f95611063-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.765451 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.765256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.766222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.766194 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c402e6d-21d6-4264-8d06-d37f95611063-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.768409 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.768378 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c402e6d-21d6-4264-8d06-d37f95611063-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.768512 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.768469 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.768557 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.768540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.768744 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.768727 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c402e6d-21d6-4264-8d06-d37f95611063-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.778709 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.778473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:50.787585 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.787564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jdf\" (UniqueName: \"kubernetes.io/projected/9c402e6d-21d6-4264-8d06-d37f95611063-kube-api-access-75jdf\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.791112 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.791080 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c402e6d-21d6-4264-8d06-d37f95611063-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-44bkf\" (UID: \"9c402e6d-21d6-4264-8d06-d37f95611063\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:50.863643 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.863617 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rzj95"] Jun 05 13:11:50.865629 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:50.865596 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3787b6e8_772d_4d30_b87a_61f403db5ec2.slice/crio-59a8daabcf7a851c02263913a2fe514f945e2e1bc8a1768653bd35341de6d8f1 WatchSource:0}: Error finding container 59a8daabcf7a851c02263913a2fe514f945e2e1bc8a1768653bd35341de6d8f1: Status 404 returned error can't find the container with id 59a8daabcf7a851c02263913a2fe514f945e2e1bc8a1768653bd35341de6d8f1 Jun 05 13:11:50.923041 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:50.923010 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:51.083569 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:51.083541 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf"] Jun 05 13:11:51.085448 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:11:51.085419 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c402e6d_21d6_4264_8d06_d37f95611063.slice/crio-b69296a75f3225f5c05b7f579cb54d637e3ff081e0bc794a79d9b69aa9a8325b WatchSource:0}: Error finding container b69296a75f3225f5c05b7f579cb54d637e3ff081e0bc794a79d9b69aa9a8325b: Status 404 returned error can't find the container with id b69296a75f3225f5c05b7f579cb54d637e3ff081e0bc794a79d9b69aa9a8325b Jun 05 13:11:51.412181 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:51.412145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" event={"ID":"9c402e6d-21d6-4264-8d06-d37f95611063","Type":"ContainerStarted","Data":"b69296a75f3225f5c05b7f579cb54d637e3ff081e0bc794a79d9b69aa9a8325b"} Jun 05 13:11:51.413381 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:51.413353 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" event={"ID":"3787b6e8-772d-4d30-b87a-61f403db5ec2","Type":"ContainerStarted","Data":"59a8daabcf7a851c02263913a2fe514f945e2e1bc8a1768653bd35341de6d8f1"} Jun 05 13:11:51.528324 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:51.528286 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:51.903372 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:51.903335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:53.409660 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:53.409621 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:54.206297 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.206260 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:11:54.206376 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.206329 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:11:54.433467 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.433431 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" event={"ID":"3787b6e8-772d-4d30-b87a-61f403db5ec2","Type":"ContainerStarted","Data":"5afef6701c13e595f8c51861f98c02367e6e3cafd63c2bfb5cefcf2975334dba"} Jun 05 13:11:54.433941 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.433606 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:11:54.435083 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.435064 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" event={"ID":"9c402e6d-21d6-4264-8d06-d37f95611063","Type":"ContainerStarted","Data":"a7dd4416ebabb1947e539ed319c9c058e87cff34184c2cd1942f0da4ebe2dbf1"} Jun 05 13:11:54.435209 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.435195 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:54.499929 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.499867 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" podStartSLOduration=1.163555702 podStartE2EDuration="4.499847202s" totalImagesPullingTime="3.3362915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:11:54.49951585 +0000 UTC m=+649.191028851" watchObservedRunningTime="2026-06-05 13:11:54.499847202 +0000 UTC m=+649.191360181" Jun 05 13:11:54.552192 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:54.552128 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" podStartSLOduration=1.433423066 podStartE2EDuration="4.552091851s" totalImagesPullingTime="3.118668785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:11:54.548976317 +0000 UTC m=+649.240489298" watchObservedRunningTime="2026-06-05 13:11:54.552091851 +0000 UTC m=+649.243604825" Jun 05 13:11:55.151520 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:55.151477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:55.442715 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:55.442637 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-44bkf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 13:11:55.442715 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:55.442687 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" podUID="9c402e6d-21d6-4264-8d06-d37f95611063" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:11:55.486569 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:55.486537 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:55.782299 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:55.782262 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:56.019441 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:56.019399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:56.229039 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:56.229004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:56.461923 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:56.461893 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:57.481165 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:57.481095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:57.744029 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:57.743945 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:58.441943 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:58.441915 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-44bkf" Jun 05 13:11:59.752282 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:59.752243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:11:59.941616 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:11:59.941576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:01.701304 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:01.701266 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:01.902309 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:01.902276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:02.108058 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:02.108028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:02.261151 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:02.261096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:05.443413 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:05.443376 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rzj95" Jun 05 13:12:06.053069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:06.052975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:06.419522 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:06.419428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:06.880321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:06.880278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:07.558008 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:07.557964 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:13.963909 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:13.963869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:14.321735 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:14.321633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:16.450662 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:16.450628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:16.958901 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:16.958862 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:17.942653 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:17.942620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:18.194644 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:18.194562 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:22.226490 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:22.226452 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:22.521250 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:22.521144 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:22.846703 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:22.846626 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:23.007407 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:23.007375 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:26.208639 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:26.208601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:26.324733 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:26.324679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:33.020247 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:33.020210 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:33.136572 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:33.136518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:35.470205 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:35.470167 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:12:35.566738 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:12:35.566708 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:08.596567 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:08.596469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:08.747058 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:08.747020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:11.231879 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.231847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:11.374931 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.374903 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:11.484778 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.484696 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:11.885747 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.885670 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:13:11.889267 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.889251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:11.894505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.894478 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fj5pc\"" Jun 05 13:13:11.894505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.894478 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 13:13:11.911666 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.911641 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:13:11.962308 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.962273 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:13:11.985978 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.985950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhjsx\" (UniqueName: \"kubernetes.io/projected/6b2ef452-7d6c-435f-867d-811cf2ee3723-kube-api-access-mhjsx\") pod \"limitador-limitador-54d6d988d5-95nzg\" (UID: \"6b2ef452-7d6c-435f-867d-811cf2ee3723\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:11.986153 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:11.986006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b2ef452-7d6c-435f-867d-811cf2ee3723-config-file\") pod \"limitador-limitador-54d6d988d5-95nzg\" (UID: \"6b2ef452-7d6c-435f-867d-811cf2ee3723\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:12.086957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.086920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b2ef452-7d6c-435f-867d-811cf2ee3723-config-file\") pod \"limitador-limitador-54d6d988d5-95nzg\" (UID: \"6b2ef452-7d6c-435f-867d-811cf2ee3723\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:12.087157 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.087000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhjsx\" (UniqueName: \"kubernetes.io/projected/6b2ef452-7d6c-435f-867d-811cf2ee3723-kube-api-access-mhjsx\") pod \"limitador-limitador-54d6d988d5-95nzg\" (UID: \"6b2ef452-7d6c-435f-867d-811cf2ee3723\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:12.087584 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.087564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b2ef452-7d6c-435f-867d-811cf2ee3723-config-file\") pod \"limitador-limitador-54d6d988d5-95nzg\" (UID: \"6b2ef452-7d6c-435f-867d-811cf2ee3723\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:12.098375 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.098348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhjsx\" (UniqueName: \"kubernetes.io/projected/6b2ef452-7d6c-435f-867d-811cf2ee3723-kube-api-access-mhjsx\") pod \"limitador-limitador-54d6d988d5-95nzg\" (UID: \"6b2ef452-7d6c-435f-867d-811cf2ee3723\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:12.200078 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.199999 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:12.317082 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.317047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:12.364398 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.364365 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:13:12.365518 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:13:12.365493 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2ef452_7d6c_435f_867d_811cf2ee3723.slice/crio-705431922b6a7d7209421bb8d3afa7e113eb76ba94fcebaec5355091df77fc16 WatchSource:0}: Error finding container 705431922b6a7d7209421bb8d3afa7e113eb76ba94fcebaec5355091df77fc16: Status 404 returned error can't find the container with id 705431922b6a7d7209421bb8d3afa7e113eb76ba94fcebaec5355091df77fc16 Jun 05 13:13:12.472882 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.472849 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:12.884543 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:12.884455 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" event={"ID":"6b2ef452-7d6c-435f-867d-811cf2ee3723","Type":"ContainerStarted","Data":"705431922b6a7d7209421bb8d3afa7e113eb76ba94fcebaec5355091df77fc16"} Jun 05 13:13:15.903012 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:15.902982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" event={"ID":"6b2ef452-7d6c-435f-867d-811cf2ee3723","Type":"ContainerStarted","Data":"d0f9573e3d45824d55e5c2722013b973515bfad48c0464335d7497ec3c585abf"} Jun 05 13:13:15.903422 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:15.903053 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:15.925321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:15.925274 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" podStartSLOduration=2.4365664369999998 podStartE2EDuration="4.925258773s" totalImagesPullingTime="2.488692336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:15.922974737 +0000 UTC m=+730.614487712" watchObservedRunningTime="2026-06-05 13:13:15.925258773 +0000 UTC m=+730.616771760" Jun 05 13:13:26.910175 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:26.910148 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-95nzg" Jun 05 13:13:32.434816 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:32.434767 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:42.491298 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:42.491259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:42.626440 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:42.626402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:42.952175 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:42.952071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:13:44.683308 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.683275 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh"] Jun 05 13:13:44.687048 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.687027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.689984 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.689962 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:13:44.690868 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.690852 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:13:44.690917 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.690867 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zppkr\"" Jun 05 13:13:44.708373 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.708351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh"] Jun 05 13:13:44.749716 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.749683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.749871 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.749723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.749871 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.749749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwp2n\" (UniqueName: \"kubernetes.io/projected/8776bb19-f8fa-4c39-a476-3fc212a2f646-kube-api-access-mwp2n\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.851256 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.851224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.851415 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.851263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.851415 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.851293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwp2n\" (UniqueName: \"kubernetes.io/projected/8776bb19-f8fa-4c39-a476-3fc212a2f646-kube-api-access-mwp2n\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.851628 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.851605 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.851680 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.851663 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.865486 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.865459 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwp2n\" (UniqueName: \"kubernetes.io/projected/8776bb19-f8fa-4c39-a476-3fc212a2f646-kube-api-access-mwp2n\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:44.996400 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:44.996369 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:45.150668 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:45.150638 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh"] Jun 05 13:13:45.153613 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:13:45.153585 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8776bb19_f8fa_4c39_a476_3fc212a2f646.slice/crio-0f1e75b0f7e6c494a0115172498b3da92f2810e1bc1ce0e0d5d2fab54fcc5542 WatchSource:0}: Error finding container 0f1e75b0f7e6c494a0115172498b3da92f2810e1bc1ce0e0d5d2fab54fcc5542: Status 404 returned error can't find the container with id 0f1e75b0f7e6c494a0115172498b3da92f2810e1bc1ce0e0d5d2fab54fcc5542 Jun 05 13:13:46.080079 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:46.080043 2558 generic.go:356] "Generic (PLEG): container finished" podID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerID="e541bdc9d9b2fa3adfcdf03aa717a6d7806eb8b888bb8bea844ceefa22a5057a" exitCode=0 Jun 05 13:13:46.080079 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:46.080083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" event={"ID":"8776bb19-f8fa-4c39-a476-3fc212a2f646","Type":"ContainerDied","Data":"e541bdc9d9b2fa3adfcdf03aa717a6d7806eb8b888bb8bea844ceefa22a5057a"} Jun 05 13:13:46.080505 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:46.080147 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" event={"ID":"8776bb19-f8fa-4c39-a476-3fc212a2f646","Type":"ContainerStarted","Data":"0f1e75b0f7e6c494a0115172498b3da92f2810e1bc1ce0e0d5d2fab54fcc5542"} Jun 05 13:13:46.081088 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:46.081071 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:13:47.088622 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:47.088586 2558 generic.go:356] "Generic (PLEG): container finished" podID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerID="d010b5ebfc97ef0279ee61ec1e9c8fdcda45ac0897c98f1488d46220e7dbfc07" exitCode=0 Jun 05 13:13:47.088987 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:47.088642 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" event={"ID":"8776bb19-f8fa-4c39-a476-3fc212a2f646","Type":"ContainerDied","Data":"d010b5ebfc97ef0279ee61ec1e9c8fdcda45ac0897c98f1488d46220e7dbfc07"} Jun 05 13:13:48.096053 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:48.096021 2558 generic.go:356] "Generic (PLEG): container finished" podID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerID="16b690d963d168073c987898342167fba74bd3a6df57400454f3970a3b6539cb" exitCode=0 Jun 05 13:13:48.096474 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:48.096138 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" event={"ID":"8776bb19-f8fa-4c39-a476-3fc212a2f646","Type":"ContainerDied","Data":"16b690d963d168073c987898342167fba74bd3a6df57400454f3970a3b6539cb"} Jun 05 13:13:49.252438 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.252415 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:49.290950 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.290925 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-bundle\") pod \"8776bb19-f8fa-4c39-a476-3fc212a2f646\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " Jun 05 13:13:49.291083 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.290956 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwp2n\" (UniqueName: \"kubernetes.io/projected/8776bb19-f8fa-4c39-a476-3fc212a2f646-kube-api-access-mwp2n\") pod \"8776bb19-f8fa-4c39-a476-3fc212a2f646\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " Jun 05 13:13:49.291083 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.291030 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-util\") pod \"8776bb19-f8fa-4c39-a476-3fc212a2f646\" (UID: \"8776bb19-f8fa-4c39-a476-3fc212a2f646\") " Jun 05 13:13:49.291530 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.291497 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-bundle" (OuterVolumeSpecName: "bundle") pod "8776bb19-f8fa-4c39-a476-3fc212a2f646" (UID: "8776bb19-f8fa-4c39-a476-3fc212a2f646"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:13:49.293038 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.293020 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8776bb19-f8fa-4c39-a476-3fc212a2f646-kube-api-access-mwp2n" (OuterVolumeSpecName: "kube-api-access-mwp2n") pod "8776bb19-f8fa-4c39-a476-3fc212a2f646" (UID: "8776bb19-f8fa-4c39-a476-3fc212a2f646"). InnerVolumeSpecName "kube-api-access-mwp2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:13:49.297514 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.297491 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-util" (OuterVolumeSpecName: "util") pod "8776bb19-f8fa-4c39-a476-3fc212a2f646" (UID: "8776bb19-f8fa-4c39-a476-3fc212a2f646"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:13:49.391801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.391699 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-bundle\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:13:49.391801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.391744 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwp2n\" (UniqueName: \"kubernetes.io/projected/8776bb19-f8fa-4c39-a476-3fc212a2f646-kube-api-access-mwp2n\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:13:49.391801 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:49.391754 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8776bb19-f8fa-4c39-a476-3fc212a2f646-util\") on node \"ip-10-0-132-150.ec2.internal\" DevicePath \"\"" Jun 05 13:13:50.109596 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:50.109518 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" Jun 05 13:13:50.109738 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:50.109516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70k42gh" event={"ID":"8776bb19-f8fa-4c39-a476-3fc212a2f646","Type":"ContainerDied","Data":"0f1e75b0f7e6c494a0115172498b3da92f2810e1bc1ce0e0d5d2fab54fcc5542"} Jun 05 13:13:50.109738 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:13:50.109672 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f1e75b0f7e6c494a0115172498b3da92f2810e1bc1ce0e0d5d2fab54fcc5542" Jun 05 13:14:09.052764 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:14:09.052724 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:14:09.150951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:14:09.150915 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:14:39.611902 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:14:39.611820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:14:40.034504 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:14:40.034470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:14:48.028129 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:14:48.028080 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:14:48.190414 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:14:48.190385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:00.980415 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:00.980383 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:20.420494 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:20.420458 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:20.577223 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:20.577189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:20.958875 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:20.958843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:21.154613 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:21.154585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:21.290310 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:21.290236 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:15:29.296841 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:29.296806 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:29.376877 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:29.376846 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:15:53.337063 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:15:53.336989 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:00.690654 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:00.690616 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:05.800918 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:05.800887 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:16:05.802934 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:05.802907 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:16:13.335638 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:13.335556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:13.425041 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:13.425000 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:21.955294 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:21.955253 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:23.328935 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.328898 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9"] Jun 05 13:16:23.329343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329329 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="pull" Jun 05 13:16:23.329343 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329344 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="pull" Jun 05 13:16:23.329421 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329366 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="extract" Jun 05 13:16:23.329421 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329373 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="extract" Jun 05 13:16:23.329421 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329382 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="util" Jun 05 13:16:23.329421 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329389 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="util" Jun 05 13:16:23.329544 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.329452 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8776bb19-f8fa-4c39-a476-3fc212a2f646" containerName="extract" Jun 05 13:16:23.332634 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.332613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.336308 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.336281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 13:16:23.342067 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.342050 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 13:16:23.343860 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.343843 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j47xp\"" Jun 05 13:16:23.354778 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.354757 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 13:16:23.401854 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.401829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.401946 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.401891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.401946 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.401912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.401946 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.401929 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.402065 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.401947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmvts\" (UniqueName: \"kubernetes.io/projected/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-kube-api-access-kmvts\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.402065 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.402049 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.443951 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.443919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:23.450705 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.450681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9"] Jun 05 13:16:23.503460 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.503602 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.503602 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.503724 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmvts\" (UniqueName: \"kubernetes.io/projected/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-kube-api-access-kmvts\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.503724 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.503724 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.503957 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503926 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.504050 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.503993 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.504050 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.504032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.505804 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.505786 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.505906 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.505890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.524411 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.524388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmvts\" (UniqueName: \"kubernetes.io/projected/2bd278fe-d766-43aa-a8ec-cc38a7007bd3-kube-api-access-kmvts\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9\" (UID: \"2bd278fe-d766-43aa-a8ec-cc38a7007bd3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.645148 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.645049 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:16:23.793986 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.793958 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9"] Jun 05 13:16:23.795422 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:16:23.795396 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd278fe_d766_43aa_a8ec_cc38a7007bd3.slice/crio-6a075e3f00f9655d0b4284a62a073a0c0f92905b12c6ce1d18cbda1db1df3b66 WatchSource:0}: Error finding container 6a075e3f00f9655d0b4284a62a073a0c0f92905b12c6ce1d18cbda1db1df3b66: Status 404 returned error can't find the container with id 6a075e3f00f9655d0b4284a62a073a0c0f92905b12c6ce1d18cbda1db1df3b66 Jun 05 13:16:23.991291 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:23.991255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" event={"ID":"2bd278fe-d766-43aa-a8ec-cc38a7007bd3","Type":"ContainerStarted","Data":"6a075e3f00f9655d0b4284a62a073a0c0f92905b12c6ce1d18cbda1db1df3b66"} Jun 05 13:16:24.051226 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:24.051193 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:16:28.017154 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:28.017122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" event={"ID":"2bd278fe-d766-43aa-a8ec-cc38a7007bd3","Type":"ContainerStarted","Data":"2846fd9c3e0df913006939043d1f1fa9a3af3a6ae83865a216979b4273ddfb36"} Jun 05 13:16:29.805015 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:29.804978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:30.438151 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:30.438113 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:16:35.905623 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:35.905590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:36.214171 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:36.214138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:37.066337 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:37.066304 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:16:41.686511 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:41.686457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:45.407264 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:45.407235 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:16:46.330253 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:46.330214 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:16:58.192223 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:58.192191 2558 generic.go:356] "Generic (PLEG): container finished" podID="2bd278fe-d766-43aa-a8ec-cc38a7007bd3" containerID="2846fd9c3e0df913006939043d1f1fa9a3af3a6ae83865a216979b4273ddfb36" exitCode=0 Jun 05 13:16:58.192588 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:16:58.192259 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" event={"ID":"2bd278fe-d766-43aa-a8ec-cc38a7007bd3","Type":"ContainerDied","Data":"2846fd9c3e0df913006939043d1f1fa9a3af3a6ae83865a216979b4273ddfb36"} Jun 05 13:17:00.207173 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:00.207132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" event={"ID":"2bd278fe-d766-43aa-a8ec-cc38a7007bd3","Type":"ContainerStarted","Data":"6ec9fa1fc03b838b33c4b175d31e704aeac6a0b49d10e0da81baba2950b13f73"} Jun 05 13:17:00.232069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:00.232014 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" podStartSLOduration=2.483205934 podStartE2EDuration="37.231999359s" totalImagesPullingTime="5.143438425s" totalInitContainerRuntime="29.605355s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:16:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:17:00.230018212 +0000 UTC m=+954.921531191" watchObservedRunningTime="2026-06-05 13:17:00.231999359 +0000 UTC m=+954.923512334" Jun 05 13:17:03.645884 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:03.645853 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:17:03.646398 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:03.645907 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:17:03.658386 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:03.658364 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:17:04.173089 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.173057 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd"] Jun 05 13:17:04.177064 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.177044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.179866 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.179844 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 13:17:04.194740 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.194718 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd"] Jun 05 13:17:04.230570 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.230536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:17:04.241713 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.241688 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9" Jun 05 13:17:04.259511 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.259480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.259614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.259516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.259614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.259542 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.259614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.259567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b46p9\" (UniqueName: \"kubernetes.io/projected/e2635648-9350-4b35-9856-9beb4a9d3bef-kube-api-access-b46p9\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.259777 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.259707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2635648-9350-4b35-9856-9beb4a9d3bef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.259777 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.259754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360466 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360617 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360617 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360727 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b46p9\" (UniqueName: \"kubernetes.io/projected/e2635648-9350-4b35-9856-9beb4a9d3bef-kube-api-access-b46p9\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360839 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2635648-9350-4b35-9856-9beb4a9d3bef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360904 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360877 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.360904 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360882 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.361010 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360927 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.361010 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.360954 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.362969 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.362944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2635648-9350-4b35-9856-9beb4a9d3bef-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.363245 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.363226 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2635648-9350-4b35-9856-9beb4a9d3bef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.375672 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.375651 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b46p9\" (UniqueName: \"kubernetes.io/projected/e2635648-9350-4b35-9856-9beb4a9d3bef-kube-api-access-b46p9\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd\" (UID: \"e2635648-9350-4b35-9856-9beb4a9d3bef\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.487582 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.487553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:04.632378 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:04.632351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd"] Jun 05 13:17:04.633639 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:17:04.633616 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2635648_9350_4b35_9856_9beb4a9d3bef.slice/crio-b6093d8e348d4262f2a30f7ffa5798312d5d10aef724aa60c6c8eeb094726a1f WatchSource:0}: Error finding container b6093d8e348d4262f2a30f7ffa5798312d5d10aef724aa60c6c8eeb094726a1f: Status 404 returned error can't find the container with id b6093d8e348d4262f2a30f7ffa5798312d5d10aef724aa60c6c8eeb094726a1f Jun 05 13:17:05.185648 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:05.185612 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:17:05.237030 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:05.236990 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" event={"ID":"e2635648-9350-4b35-9856-9beb4a9d3bef","Type":"ContainerStarted","Data":"138bbf881fa9bfde2f6509f41c43a2eb1f0764d7c0ada048226c8f474820502c"} Jun 05 13:17:05.237218 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:05.237077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" event={"ID":"e2635648-9350-4b35-9856-9beb4a9d3bef","Type":"ContainerStarted","Data":"b6093d8e348d4262f2a30f7ffa5798312d5d10aef724aa60c6c8eeb094726a1f"} Jun 05 13:17:06.245086 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:06.245044 2558 generic.go:356] "Generic (PLEG): container finished" podID="e2635648-9350-4b35-9856-9beb4a9d3bef" containerID="138bbf881fa9bfde2f6509f41c43a2eb1f0764d7c0ada048226c8f474820502c" exitCode=0 Jun 05 13:17:06.245465 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:06.245138 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" event={"ID":"e2635648-9350-4b35-9856-9beb4a9d3bef","Type":"ContainerDied","Data":"138bbf881fa9bfde2f6509f41c43a2eb1f0764d7c0ada048226c8f474820502c"} Jun 05 13:17:07.253358 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:07.253327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" event={"ID":"e2635648-9350-4b35-9856-9beb4a9d3bef","Type":"ContainerStarted","Data":"7277b7f88589b3ab03afa564072443e32bcf2d48637f17e493c90a603927ed0e"} Jun 05 13:17:07.284019 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:07.283965 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" podStartSLOduration=1.633052652 podStartE2EDuration="3.283950063s" totalImagesPullingTime="319.744922ms" totalInitContainerRuntime="1.331152489s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:17:07.281174277 +0000 UTC m=+961.972687252" watchObservedRunningTime="2026-06-05 13:17:07.283950063 +0000 UTC m=+961.975463038" Jun 05 13:17:13.860119 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.860056 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz"] Jun 05 13:17:13.864847 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.864825 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:13.870223 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.870203 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 13:17:13.891342 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.891314 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz"] Jun 05 13:17:13.946114 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946077 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:17:13.946446 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:13.946495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:13.946495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946484 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hgk8\" (UniqueName: \"kubernetes.io/projected/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-kube-api-access-6hgk8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:13.946572 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:13.946614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:13.946614 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:13.946589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.047967 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.047935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.047975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.047999 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hgk8\" (UniqueName: \"kubernetes.io/projected/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-kube-api-access-6hgk8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.048044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.048064 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048164 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.048082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.048401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048471 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.048456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.048572 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.048497 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.050476 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.050448 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.050688 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.050670 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.060832 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.060802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hgk8\" (UniqueName: \"kubernetes.io/projected/6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e-kube-api-access-6hgk8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gllnz\" (UID: \"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.174850 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.174762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:14.346495 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.346463 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz"] Jun 05 13:17:14.349853 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:17:14.349825 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2cbbbc_f42f_45b8_8f6e_c6ace88c249e.slice/crio-128bf87053857c0de95efd1bf0bd47e71f818f9864e6878d569818275b3aae6a WatchSource:0}: Error finding container 128bf87053857c0de95efd1bf0bd47e71f818f9864e6878d569818275b3aae6a: Status 404 returned error can't find the container with id 128bf87053857c0de95efd1bf0bd47e71f818f9864e6878d569818275b3aae6a Jun 05 13:17:14.487819 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.487785 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:14.487999 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.487983 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:14.500586 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:14.500565 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:15.297499 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:15.297466 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95nzg"] Jun 05 13:17:15.307357 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:15.307320 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" event={"ID":"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e","Type":"ContainerStarted","Data":"9493a7010e35f533a6d72a37a4de891364dcec49f5b4443813b3347e29d40ead"} Jun 05 13:17:15.307511 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:15.307370 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" event={"ID":"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e","Type":"ContainerStarted","Data":"128bf87053857c0de95efd1bf0bd47e71f818f9864e6878d569818275b3aae6a"} Jun 05 13:17:15.318884 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:15.318861 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd" Jun 05 13:17:16.315163 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:16.315127 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e" containerID="9493a7010e35f533a6d72a37a4de891364dcec49f5b4443813b3347e29d40ead" exitCode=0 Jun 05 13:17:16.315558 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:16.315271 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" event={"ID":"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e","Type":"ContainerDied","Data":"9493a7010e35f533a6d72a37a4de891364dcec49f5b4443813b3347e29d40ead"} Jun 05 13:17:17.323372 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:17.323336 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" event={"ID":"6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e","Type":"ContainerStarted","Data":"a9235ab5ec74249742ebe57933991f0775c11938c06ed9fd2eb750fe112d8dd0"} Jun 05 13:17:17.409878 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:17.409824 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" podStartSLOduration=2.652986848 podStartE2EDuration="4.409808967s" totalImagesPullingTime="288.356578ms" totalInitContainerRuntime="1.468465541s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:17:17.408598072 +0000 UTC m=+972.100111047" watchObservedRunningTime="2026-06-05 13:17:17.409808967 +0000 UTC m=+972.101321986" Jun 05 13:17:24.175419 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:24.175338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:24.175419 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:24.175391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:24.187901 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:24.187878 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:24.376964 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:24.376936 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gllnz" Jun 05 13:17:31.838877 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:31.838843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:17:31.939485 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:17:31.939455 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:18:06.868171 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:18:06.868131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:21:05.841961 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:21:05.841926 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:21:05.844956 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:21:05.844934 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5l2w_ffaa2e3d-bccb-4110-b2f7-063438a173b1/ovn-acl-logging/0.log" Jun 05 13:21:16.723538 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:21:16.723507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:21:17.825889 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:21:17.825857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:21:17.936733 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:21:17.936689 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:22:01.870401 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:01.870326 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69fcb86bc6-xpbxt_9f245205-3553-4189-ab31-216d0d7b02e9/nginx/0.log" Jun 05 13:22:01.980222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:01.980193 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-wq2cq_be89fdbf-23cf-435b-a974-0b99ccfb8715/manager/0.log" Jun 05 13:22:02.100864 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:02.100834 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-vr7wg_8cbb1f14-e919-4718-9ed3-97f5b2e18186/manager/0.log" Jun 05 13:22:02.467904 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:02.467880 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dn2vt_2b69440b-104c-4148-b330-75a097405ca5/server/0.log" Jun 05 13:22:02.578358 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:02.578328 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-pdg9m_b5086f65-a31a-4fba-a70d-185568d174c3/manager/0.log" Jun 05 13:22:02.687508 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:02.687482 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-9h9gb_3037e423-b649-4e40-9b10-1b534af8acbd/copy-manifests/0.log" Jun 05 13:22:02.693990 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:02.693969 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-9h9gb_3037e423-b649-4e40-9b10-1b534af8acbd/manager/0.log" Jun 05 13:22:03.829492 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:03.829467 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz_a80929a5-063c-4aa0-9315-458f235d1445/util/0.log" Jun 05 13:22:03.835938 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:03.835919 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz_a80929a5-063c-4aa0-9315-458f235d1445/pull/0.log" Jun 05 13:22:03.842353 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:03.842321 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz_a80929a5-063c-4aa0-9315-458f235d1445/extract/0.log" Jun 05 13:22:03.955863 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:03.955831 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r_5f1c295a-6281-44ad-971d-0bf56a5bddcb/pull/0.log" Jun 05 13:22:03.963093 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:03.963067 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r_5f1c295a-6281-44ad-971d-0bf56a5bddcb/extract/0.log" Jun 05 13:22:03.973449 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:03.973425 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r_5f1c295a-6281-44ad-971d-0bf56a5bddcb/util/0.log" Jun 05 13:22:04.079955 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.079875 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p_dbc48bd7-0758-43ed-94be-3e01c6082839/util/0.log" Jun 05 13:22:04.086824 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.086803 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p_dbc48bd7-0758-43ed-94be-3e01c6082839/pull/0.log" Jun 05 13:22:04.096851 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.096832 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p_dbc48bd7-0758-43ed-94be-3e01c6082839/extract/0.log" Jun 05 13:22:04.213069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.213045 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d_ef605fda-be23-4d22-a155-e7b8b0a67ea3/util/0.log" Jun 05 13:22:04.220087 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.220070 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d_ef605fda-be23-4d22-a155-e7b8b0a67ea3/pull/0.log" Jun 05 13:22:04.227329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.227311 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d_ef605fda-be23-4d22-a155-e7b8b0a67ea3/extract/0.log" Jun 05 13:22:04.477979 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.477954 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rzj95_3787b6e8-772d-4d30-b87a-61f403db5ec2/manager/0.log" Jun 05 13:22:04.822241 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:04.822164 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mmmp6_25f806c8-fac5-4550-9272-ef6277a263e2/registry-server/0.log" Jun 05 13:22:05.074040 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:05.073951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-95nzg_6b2ef452-7d6c-435f-867d-811cf2ee3723/limitador/0.log" Jun 05 13:22:05.682033 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:05.681997 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-44bkf_9c402e6d-21d6-4264-8d06-d37f95611063/discovery/0.log" Jun 05 13:22:05.923644 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:05.923614 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b6cf7bfb-cjj6t_4c226ba7-f0a6-468b-99fe-9ef0719195e4/kube-auth-proxy/0.log" Jun 05 13:22:06.379719 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:06.379690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65699ffdbf-xcdnm_bb71982d-95ac-4106-bc2d-27e1d313ccb9/router/0.log" Jun 05 13:22:06.760828 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:06.760798 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9_2bd278fe-d766-43aa-a8ec-cc38a7007bd3/storage-initializer/0.log" Jun 05 13:22:06.767780 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:06.767756 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-dgwd9_2bd278fe-d766-43aa-a8ec-cc38a7007bd3/main/0.log" Jun 05 13:22:07.244538 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:07.244510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd_e2635648-9350-4b35-9856-9beb4a9d3bef/storage-initializer/0.log" Jun 05 13:22:07.251367 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:07.251351 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-m6lcd_e2635648-9350-4b35-9856-9beb4a9d3bef/main/0.log" Jun 05 13:22:07.358331 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:07.358309 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gllnz_6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e/main/0.log" Jun 05 13:22:07.364454 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:07.364427 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gllnz_6e2cbbbc-f42f-45b8-8f6e-c6ace88c249e/storage-initializer/0.log" Jun 05 13:22:11.576564 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:11.576536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:22:11.644333 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:11.644301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" limit=1024 Jun 05 13:22:14.725175 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:14.725142 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-92c4b_2e392fa5-9946-46f7-981d-867021791d0e/global-pull-secret-syncer/0.log" Jun 05 13:22:14.871721 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:14.871691 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-82n4t_7aec03db-854c-4fe2-b2ba-c1ff496dca6f/konnectivity-agent/0.log" Jun 05 13:22:15.012321 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:15.012225 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-150.ec2.internal_559b7c555df026f06f2605e41632946e/haproxy/0.log" Jun 05 13:22:18.810546 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:18.810516 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-c8hmx_da0ac1da-40fd-4341-bc4e-dfd333bee5ef/sail-operator/0.log" Jun 05 13:22:19.538726 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.538681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz_a80929a5-063c-4aa0-9315-458f235d1445/extract/0.log" Jun 05 13:22:19.563915 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.563885 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz_a80929a5-063c-4aa0-9315-458f235d1445/util/0.log" Jun 05 13:22:19.590852 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.590828 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zqxvz_a80929a5-063c-4aa0-9315-458f235d1445/pull/0.log" Jun 05 13:22:19.620601 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.620579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r_5f1c295a-6281-44ad-971d-0bf56a5bddcb/extract/0.log" Jun 05 13:22:19.651717 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.651687 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r_5f1c295a-6281-44ad-971d-0bf56a5bddcb/util/0.log" Jun 05 13:22:19.672974 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.672954 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05vj5r_5f1c295a-6281-44ad-971d-0bf56a5bddcb/pull/0.log" Jun 05 13:22:19.699945 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.699926 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p_dbc48bd7-0758-43ed-94be-3e01c6082839/extract/0.log" Jun 05 13:22:19.724899 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.724880 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p_dbc48bd7-0758-43ed-94be-3e01c6082839/util/0.log" Jun 05 13:22:19.747794 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.747771 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m5k9p_dbc48bd7-0758-43ed-94be-3e01c6082839/pull/0.log" Jun 05 13:22:19.783828 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.783812 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d_ef605fda-be23-4d22-a155-e7b8b0a67ea3/extract/0.log" Jun 05 13:22:19.824385 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.824333 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d_ef605fda-be23-4d22-a155-e7b8b0a67ea3/util/0.log" Jun 05 13:22:19.854286 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.854268 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tmn7d_ef605fda-be23-4d22-a155-e7b8b0a67ea3/pull/0.log" Jun 05 13:22:19.932995 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:19.932970 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rzj95_3787b6e8-772d-4d30-b87a-61f403db5ec2/manager/0.log" Jun 05 13:22:20.036011 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:20.035984 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mmmp6_25f806c8-fac5-4550-9272-ef6277a263e2/registry-server/0.log" Jun 05 13:22:20.107195 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:20.107092 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-95nzg_6b2ef452-7d6c-435f-867d-811cf2ee3723/limitador/0.log" Jun 05 13:22:21.909893 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:21.909850 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-zbqbz_f27929ce-2303-49e0-ab32-1ae3f60652b8/kube-state-metrics/0.log" Jun 05 13:22:21.927247 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:21.927223 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-zbqbz_f27929ce-2303-49e0-ab32-1ae3f60652b8/kube-rbac-proxy-main/0.log" Jun 05 13:22:21.949124 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:21.949077 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-zbqbz_f27929ce-2303-49e0-ab32-1ae3f60652b8/kube-rbac-proxy-self/0.log" Jun 05 13:22:22.242935 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.242904 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7w9l_18bb62cb-8606-4626-ab13-506ff53f1088/node-exporter/0.log" Jun 05 13:22:22.284212 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.284189 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7w9l_18bb62cb-8606-4626-ab13-506ff53f1088/kube-rbac-proxy/0.log" Jun 05 13:22:22.311923 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.311902 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7w9l_18bb62cb-8606-4626-ab13-506ff53f1088/init-textfile/0.log" Jun 05 13:22:22.339259 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.339236 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-9zcvg_ade602c1-00be-49db-959a-6efd1e877c9b/kube-rbac-proxy-main/0.log" Jun 05 13:22:22.373259 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.373240 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-9zcvg_ade602c1-00be-49db-959a-6efd1e877c9b/kube-rbac-proxy-self/0.log" Jun 05 13:22:22.401424 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.401406 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-9zcvg_ade602c1-00be-49db-959a-6efd1e877c9b/openshift-state-metrics/0.log" Jun 05 13:22:22.611787 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.611701 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-sbdrg_2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e/prometheus-operator/0.log" Jun 05 13:22:22.631524 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.631502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-sbdrg_2a2e0b4a-038b-4b89-8b1b-04c26b28ed8e/kube-rbac-proxy/0.log" Jun 05 13:22:22.776397 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.776375 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778798f46-gprvv_d8836b12-5d6d-47dc-be14-69a2069ef146/thanos-query/0.log" Jun 05 13:22:22.797081 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.797059 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778798f46-gprvv_d8836b12-5d6d-47dc-be14-69a2069ef146/kube-rbac-proxy-web/0.log" Jun 05 13:22:22.820021 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.819999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778798f46-gprvv_d8836b12-5d6d-47dc-be14-69a2069ef146/kube-rbac-proxy/0.log" Jun 05 13:22:22.842753 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.842733 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778798f46-gprvv_d8836b12-5d6d-47dc-be14-69a2069ef146/prom-label-proxy/0.log" Jun 05 13:22:22.864444 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.864395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778798f46-gprvv_d8836b12-5d6d-47dc-be14-69a2069ef146/kube-rbac-proxy-rules/0.log" Jun 05 13:22:22.888496 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:22.888479 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778798f46-gprvv_d8836b12-5d6d-47dc-be14-69a2069ef146/kube-rbac-proxy-metrics/0.log" Jun 05 13:22:25.305301 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.305277 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9c86895c8-qdx4z_b2839cb8-ba95-4c5b-91a0-65ef51c64c9a/console/0.log" Jun 05 13:22:25.343172 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.343144 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq"] Jun 05 13:22:25.347030 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.347011 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.349599 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.349571 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnzwf\"/\"kube-root-ca.crt\"" Jun 05 13:22:25.350387 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.350357 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fnzwf\"/\"default-dockercfg-b24jj\"" Jun 05 13:22:25.350487 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.350362 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnzwf\"/\"openshift-service-ca.crt\"" Jun 05 13:22:25.356236 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.356217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq"] Jun 05 13:22:25.401569 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.401538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-sys\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.401693 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.401572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-lib-modules\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.401693 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.401603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-proc\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.401693 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.401641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swlml\" (UniqueName: \"kubernetes.io/projected/ca450693-a2eb-449d-8d10-0fbb473478f9-kube-api-access-swlml\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.401826 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.401729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-podres\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502222 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-proc\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swlml\" (UniqueName: \"kubernetes.io/projected/ca450693-a2eb-449d-8d10-0fbb473478f9-kube-api-access-swlml\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502288 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-podres\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502329 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502321 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-proc\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502446 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-sys\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502446 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502375 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-lib-modules\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502446 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-podres\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502549 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502463 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-sys\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.502549 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.502502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca450693-a2eb-449d-8d10-0fbb473478f9-lib-modules\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.510590 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.510568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swlml\" (UniqueName: \"kubernetes.io/projected/ca450693-a2eb-449d-8d10-0fbb473478f9-kube-api-access-swlml\") pod \"perf-node-gather-daemonset-qlgnq\" (UID: \"ca450693-a2eb-449d-8d10-0fbb473478f9\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.658640 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.658555 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:25.790266 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:25.790240 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq"] Jun 05 13:22:25.791157 ip-10-0-132-150 kubenswrapper[2558]: W0605 13:22:25.791136 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podca450693_a2eb_449d_8d10_0fbb473478f9.slice/crio-9249e3b7d47e5d26adeba72327d73090e5b92c48e491dd09d027d53f3dfcd6ea WatchSource:0}: Error finding container 9249e3b7d47e5d26adeba72327d73090e5b92c48e491dd09d027d53f3dfcd6ea: Status 404 returned error can't find the container with id 9249e3b7d47e5d26adeba72327d73090e5b92c48e491dd09d027d53f3dfcd6ea Jun 05 13:22:26.062753 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:26.062719 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-4jpbf_72944760-a737-4108-844a-9ef4601f6a70/volume-data-source-validator/0.log" Jun 05 13:22:26.158140 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:26.158084 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" event={"ID":"ca450693-a2eb-449d-8d10-0fbb473478f9","Type":"ContainerStarted","Data":"65e6109643a5b3049bf73f115ac8c4f52dfe2454fe79ee99d4b17d974c5c609f"} Jun 05 13:22:26.158305 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:26.158194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" event={"ID":"ca450693-a2eb-449d-8d10-0fbb473478f9","Type":"ContainerStarted","Data":"9249e3b7d47e5d26adeba72327d73090e5b92c48e491dd09d027d53f3dfcd6ea"} Jun 05 13:22:26.158305 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:26.158227 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:26.175373 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:26.175327 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" podStartSLOduration=1.175312207 podStartE2EDuration="1.175312207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:22:26.172906479 +0000 UTC m=+1280.864419454" watchObservedRunningTime="2026-06-05 13:22:26.175312207 +0000 UTC m=+1280.866825181" Jun 05 13:22:27.161469 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:27.161430 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9qxkm_6a00ab16-fe20-4cdf-8de9-c7405990f067/dns/0.log" Jun 05 13:22:27.181627 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:27.181607 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9qxkm_6a00ab16-fe20-4cdf-8de9-c7405990f067/kube-rbac-proxy/0.log" Jun 05 13:22:27.320608 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:27.320582 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6mbd_c8c417c3-66f0-49cd-a8f5-e8a4eb00d657/dns-node-resolver/0.log" Jun 05 13:22:27.970571 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:27.970538 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nr54c_19bdefc7-f77d-4dcc-ba01-f2cdddf63112/node-ca/0.log" Jun 05 13:22:28.979157 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:28.979131 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-44bkf_9c402e6d-21d6-4264-8d06-d37f95611063/discovery/0.log" Jun 05 13:22:29.026238 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:29.026212 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b6cf7bfb-cjj6t_4c226ba7-f0a6-468b-99fe-9ef0719195e4/kube-auth-proxy/0.log" Jun 05 13:22:29.140413 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:29.140384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65699ffdbf-xcdnm_bb71982d-95ac-4106-bc2d-27e1d313ccb9/router/0.log" Jun 05 13:22:29.737714 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:29.737689 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clnk2_bdd3098c-6ec6-4068-8990-590cb87e218d/serve-healthcheck-canary/0.log" Jun 05 13:22:30.299877 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:30.299838 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5t2lj_1c76abce-52fc-490e-a23e-c08c4509f1b9/insights-operator/1.log" Jun 05 13:22:30.304916 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:30.304890 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5t2lj_1c76abce-52fc-490e-a23e-c08c4509f1b9/insights-operator/0.log" Jun 05 13:22:30.473716 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:30.473691 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kx6xz_56e26b3c-e2a7-4cd1-8f30-8901dad12390/kube-rbac-proxy/0.log" Jun 05 13:22:30.494140 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:30.494121 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kx6xz_56e26b3c-e2a7-4cd1-8f30-8901dad12390/exporter/0.log" Jun 05 13:22:30.516108 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:30.516088 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kx6xz_56e26b3c-e2a7-4cd1-8f30-8901dad12390/extractor/0.log" Jun 05 13:22:32.175069 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:32.175038 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-qlgnq" Jun 05 13:22:32.852301 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:32.852273 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69fcb86bc6-xpbxt_9f245205-3553-4189-ab31-216d0d7b02e9/nginx/0.log" Jun 05 13:22:32.895144 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:32.895117 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-wq2cq_be89fdbf-23cf-435b-a974-0b99ccfb8715/manager/0.log" Jun 05 13:22:32.956314 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:32.956272 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-vr7wg_8cbb1f14-e919-4718-9ed3-97f5b2e18186/manager/0.log" Jun 05 13:22:33.096526 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:33.096411 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dn2vt_2b69440b-104c-4148-b330-75a097405ca5/server/0.log" Jun 05 13:22:33.177866 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:33.177840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-pdg9m_b5086f65-a31a-4fba-a70d-185568d174c3/manager/0.log" Jun 05 13:22:33.206362 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:33.206311 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-9h9gb_3037e423-b649-4e40-9b10-1b534af8acbd/manager/0.log" Jun 05 13:22:33.231736 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:33.231714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-9h9gb_3037e423-b649-4e40-9b10-1b534af8acbd/copy-manifests/0.log" Jun 05 13:22:35.192675 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:35.192641 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pkvcq_9e558016-279e-4c93-a1e5-35009382d2c4/openshift-lws-operator/0.log" Jun 05 13:22:39.610956 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:39.610927 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-44bkf_9c402e6d-21d6-4264-8d06-d37f95611063/discovery/0.log" Jun 05 13:22:39.642854 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:39.642824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b6cf7bfb-cjj6t_4c226ba7-f0a6-468b-99fe-9ef0719195e4/kube-auth-proxy/0.log" Jun 05 13:22:39.717269 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:39.717246 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65699ffdbf-xcdnm_bb71982d-95ac-4106-bc2d-27e1d313ccb9/router/0.log" Jun 05 13:22:40.847232 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:40.847195 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-44bkf_9c402e6d-21d6-4264-8d06-d37f95611063/discovery/0.log" Jun 05 13:22:40.874538 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:40.874510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74b6cf7bfb-cjj6t_4c226ba7-f0a6-468b-99fe-9ef0719195e4/kube-auth-proxy/0.log" Jun 05 13:22:40.943887 ip-10-0-132-150 kubenswrapper[2558]: I0605 13:22:40.943859 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65699ffdbf-xcdnm_bb71982d-95ac-4106-bc2d-27e1d313ccb9/router/0.log"