Jun 10 12:46:31.696894 ip-10-0-128-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 12:46:31.696905 ip-10-0-128-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 12:46:31.696915 ip-10-0-128-84 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 12:46:31.697148 ip-10-0-128-84 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 12:46:42.886746 ip-10-0-128-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 12:46:42.886761 ip-10-0-128-84 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 035c407fff384b64b92dc20bd9f2ea65 -- Jun 10 12:49:05.297668 ip-10-0-128-84 systemd[1]: Starting Kubernetes Kubelet... Jun 10 12:49:05.772127 ip-10-0-128-84 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:49:05.772127 ip-10-0-128-84 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 12:49:05.772127 ip-10-0-128-84 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:49:05.772127 ip-10-0-128-84 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 12:49:05.772127 ip-10-0-128-84 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:49:05.774731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.774648 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 12:49:05.779325 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779308 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:49:05.779325 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779324 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779328 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779332 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779335 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779338 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779342 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779359 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779362 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779365 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779368 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779371 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779374 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779377 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779380 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779382 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779385 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779387 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779391 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779393 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779396 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:49:05.779399 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779399 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779401 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779404 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779407 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779410 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779413 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779417 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779421 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779424 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779427 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779430 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779433 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779435 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779438 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779441 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779444 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779446 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779450 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779452 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:49:05.779883 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779455 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779457 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779460 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779462 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779465 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779467 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779470 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779472 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779475 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779477 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779481 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779484 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779489 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779493 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779496 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779500 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779503 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779506 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779509 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:49:05.780341 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779512 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779515 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779518 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779520 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779524 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779526 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779529 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779531 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779534 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779536 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779539 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779542 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779545 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779547 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779550 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779553 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779555 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779557 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779560 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779562 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:49:05.780827 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779565 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779567 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779570 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779572 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779575 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779578 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779580 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779583 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779586 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779589 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779591 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779594 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779596 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779599 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779602 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779604 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779607 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779609 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779612 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.779614 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:49:05.781313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780361 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780368 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780371 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780374 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780377 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780380 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780383 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780386 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780388 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780391 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780393 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780396 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780399 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780402 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780404 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780407 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780410 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780412 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780415 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780417 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:49:05.781852 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780421 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780423 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780426 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780429 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780431 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780434 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780437 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780440 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780442 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780445 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780447 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780450 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780452 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780455 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780457 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780460 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780462 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780465 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780468 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780470 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:49:05.782377 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780473 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780475 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780478 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780480 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780484 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780488 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780492 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780494 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780497 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780499 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780502 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780504 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780508 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780510 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780513 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780516 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780519 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780523 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780526 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:49:05.782866 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780530 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780533 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780536 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780539 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780542 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780545 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780547 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780550 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780552 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780556 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780558 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780561 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780564 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780566 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780569 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780572 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780574 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780577 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780582 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:49:05.783334 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780585 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780587 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780590 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780593 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780595 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780598 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780600 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780603 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780606 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780608 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780611 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780613 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780616 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780619 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780621 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780624 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780626 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780629 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780631 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780634 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:49:05.783812 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780636 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780989 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780994 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780996 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.780999 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781002 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781004 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781008 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781011 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781013 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781016 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781021 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781024 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781026 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781029 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781031 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781034 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781037 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781040 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781043 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:49:05.784302 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781045 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781048 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781050 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781053 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781056 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781058 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781061 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781063 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781066 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781068 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781072 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781074 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781077 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781079 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781082 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781084 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781087 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781089 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781092 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781094 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:49:05.784825 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781097 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781099 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781102 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781106 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781109 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781111 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781114 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781116 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781121 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781125 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781128 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781131 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781134 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781136 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781139 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781141 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781144 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781146 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781149 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781152 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:49:05.785329 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781154 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781157 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781160 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781163 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781165 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781168 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781170 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781173 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781175 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781178 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781180 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781183 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781185 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781188 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781191 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781194 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781197 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781199 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781202 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:49:05.785849 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781206 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781208 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781211 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781213 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781216 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781218 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781222 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781226 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781229 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781232 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781235 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781237 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781240 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781242 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781245 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781247 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781250 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781252 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781255 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:49:05.786331 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781257 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.781260 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781329 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781337 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781343 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781363 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781370 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781375 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781379 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781384 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781387 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781390 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781394 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781399 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781402 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781405 2576 flags.go:64] FLAG: --cgroup-root="" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781407 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781410 2576 flags.go:64] FLAG: --client-ca-file="" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781413 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781416 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781420 2576 flags.go:64] FLAG: --cluster-domain="" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781423 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781426 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781429 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 12:49:05.786844 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781433 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781437 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781440 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781443 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781446 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781449 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781452 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781455 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781458 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781461 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781466 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781468 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781471 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781474 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781477 2576 flags.go:64] FLAG: --enable-server="true" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.781480 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782029 2576 flags.go:64] FLAG: --event-burst="100" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782033 2576 flags.go:64] FLAG: --event-qps="50" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782036 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782040 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782043 2576 flags.go:64] FLAG: --eviction-hard="" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782047 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782050 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782053 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782056 2576 flags.go:64] FLAG: --eviction-soft="" Jun 10 12:49:05.787481 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782059 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782062 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782065 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782068 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782071 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782074 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782077 2576 flags.go:64] FLAG: --feature-gates="" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782080 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782083 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782086 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782089 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782092 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782095 2576 flags.go:64] FLAG: --help="false" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782098 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-84.ec2.internal" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782101 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782104 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782107 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782110 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782114 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782116 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782119 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782122 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782125 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 12:49:05.788088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782129 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782132 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782135 2576 flags.go:64] FLAG: --kube-reserved="" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782138 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782140 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782144 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782147 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782150 2576 flags.go:64] FLAG: --lock-file="" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782153 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782156 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782159 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782164 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782167 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782170 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782173 2576 flags.go:64] FLAG: --logging-format="text" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782177 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782180 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782183 2576 flags.go:64] FLAG: --manifest-url="" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782186 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782193 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782196 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782201 2576 flags.go:64] FLAG: --max-pods="110" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782204 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782207 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782210 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 12:49:05.788702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782213 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782216 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782219 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782222 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782229 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782232 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782235 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782238 2576 flags.go:64] FLAG: --pod-cidr="" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782241 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782247 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782250 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782253 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782256 2576 flags.go:64] FLAG: --port="10250" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782259 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782262 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08839ea9d69ab824a" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782265 2576 flags.go:64] FLAG: --qos-reserved="" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782268 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782271 2576 flags.go:64] FLAG: --register-node="true" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782274 2576 flags.go:64] FLAG: --register-with-taints="" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782278 2576 flags.go:64] FLAG: --registry-burst="10" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782280 2576 flags.go:64] FLAG: --registry-qps="5" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782284 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782286 2576 flags.go:64] FLAG: --reserved-memory="" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782290 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782293 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 12:49:05.789362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782296 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782299 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782302 2576 flags.go:64] FLAG: --runonce="false" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782305 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782307 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782311 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782313 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782316 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782319 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782322 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782325 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782328 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782331 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782333 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782336 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782341 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782359 2576 flags.go:64] FLAG: --system-cgroups="" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782362 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782367 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782370 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782373 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782377 2576 flags.go:64] FLAG: --tls-min-version="" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782380 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782383 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782386 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 12:49:05.789981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782389 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782392 2576 flags.go:64] FLAG: --v="2" Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782396 2576 flags.go:64] FLAG: --version="false" Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782400 2576 flags.go:64] FLAG: --vmodule="" Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782403 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.782407 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782524 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782528 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782531 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782534 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782537 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782540 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782543 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782545 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782548 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782551 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782553 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782556 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782561 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782564 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:49:05.790612 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782566 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782570 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782573 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782576 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782578 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782581 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782585 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782587 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782590 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782592 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782596 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782599 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782602 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782605 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782608 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782611 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782613 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782616 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782619 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782621 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:49:05.791122 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782624 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782627 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782630 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782632 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782635 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782637 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782640 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782643 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782645 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782648 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782650 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782654 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782657 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782661 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782664 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782667 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782670 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782673 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782677 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:49:05.791633 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782679 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782682 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782685 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782688 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782690 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782693 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782695 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782698 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782701 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782703 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782706 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782708 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782711 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782714 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782717 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782719 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782721 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782724 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782726 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782729 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:49:05.792114 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782732 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782734 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782736 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782739 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782741 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782744 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782747 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782750 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782752 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782755 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782758 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782762 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782764 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782768 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782772 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782775 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782778 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782781 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782784 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:49:05.792625 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782787 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782790 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782793 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782795 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782798 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.782801 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.783936 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.791011 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.791030 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.791049 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.791057 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791132 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791138 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791141 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791144 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:49:05.793085 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791147 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791150 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791152 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791155 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791158 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791161 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791163 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791166 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791168 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791171 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791174 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791176 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791179 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791182 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791184 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791187 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791190 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791193 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791195 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791197 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:49:05.793473 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791200 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791203 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791205 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791208 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791210 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791219 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791222 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791225 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791228 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791231 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791233 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791236 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791240 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791242 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791245 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791247 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791250 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791253 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791255 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791258 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:49:05.793977 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791260 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791263 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791266 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791268 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791271 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791273 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791277 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791280 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791283 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791286 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791289 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791292 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791294 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791297 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791299 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791302 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791304 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791308 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791316 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:49:05.794479 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791319 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791322 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791325 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791328 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791330 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791333 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791335 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791338 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791341 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791343 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791360 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791363 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791366 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791369 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791371 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791374 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791377 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791379 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791382 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:49:05.794942 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791385 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791387 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791390 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791393 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791396 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791398 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791402 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791406 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791409 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791412 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791414 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791417 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791420 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791429 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791432 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791434 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:49:05.795594 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791437 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.791442 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791610 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791616 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791619 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791622 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791625 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791628 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791631 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791633 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791636 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791639 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791642 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791644 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791647 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:49:05.795989 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791649 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791652 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791654 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791657 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791660 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791662 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791665 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791668 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791670 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791673 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791675 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791678 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791681 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791684 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791686 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791695 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791697 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791701 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791705 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791708 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:49:05.796374 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791710 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791713 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791716 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791718 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791721 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791724 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791726 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791729 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791731 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791734 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791736 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791739 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791742 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791744 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791747 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791749 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791751 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791754 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791756 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:49:05.796900 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791759 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791761 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791764 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791766 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791769 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791771 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791774 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791776 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791779 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791787 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791789 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791792 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791794 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791797 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791799 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791802 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791804 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791807 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791809 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791812 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:49:05.797361 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791814 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791817 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791819 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791822 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791825 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791827 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791830 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791832 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791834 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791837 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791840 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791842 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791844 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791847 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791849 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791852 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791856 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791859 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791862 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:49:05.797857 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791865 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791869 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791872 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791880 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791883 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791885 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791888 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:05.791890 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.791895 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.792010 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.794470 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.796228 2576 server.go:1019] "Starting client certificate rotation" Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.796337 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:49:05.798313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.796389 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:49:05.799005 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.798991 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:49:05.805496 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.805470 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:49:05.815520 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.815502 2576 log.go:25] "Validated CRI v1 runtime API" Jun 10 12:49:05.819428 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.819408 2576 log.go:25] "Validated CRI v1 image API" Jun 10 12:49:05.820152 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.820134 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 12:49:05.823590 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.823568 2576 fs.go:135] Filesystem UUIDs: map[38f145f5-ecdd-465d-a409-fa377ed31413:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ef9450a9-f5b0-4ff0-981c-9de2a31972dc:/dev/nvme0n1p4] Jun 10 12:49:05.823659 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.823588 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 12:49:05.826697 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.826678 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:49:05.829477 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.829370 2576 manager.go:216] Machine: {Timestamp:2026-06-10 12:49:05.827607554 +0000 UTC m=+0.392589296 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099474 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2653c4ed25f366bdc35eead1ffdc SystemUUID:ec2e2653-c4ed-25f3-66bd-c35eead1ffdc BootID:035c407f-ff38-4b64-b92d-c20bd9f2ea65 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:2a:f2:89:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:2a:f2:89:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:df:b1:03:91:f4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 12:49:05.829477 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.829473 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 12:49:05.829595 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.829561 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 12:49:05.833368 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.833328 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 12:49:05.833500 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.833369 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 12:49:05.834852 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.834841 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 12:49:05.834887 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.834854 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 12:49:05.834887 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.834867 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:49:05.835851 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.835840 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:49:05.837225 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.837214 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 12:49:05.841398 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841386 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:49:05.841532 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841522 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 12:49:05.841568 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841551 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 10 12:49:05.841568 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841562 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 12:49:05.841625 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841572 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 12:49:05.841625 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841585 2576 kubelet.go:398] "Adding apiserver pod source" Jun 10 12:49:05.841625 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.841595 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 12:49:05.842032 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.842017 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:49:05.842076 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.842060 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:49:05.844643 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.844620 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 12:49:05.846499 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.846485 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 12:49:05.846571 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.846515 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 12:49:05.847703 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847692 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847708 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847714 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847719 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847727 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847733 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847741 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 12:49:05.847744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847746 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 12:49:05.847917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847753 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 12:49:05.847917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847758 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 12:49:05.847917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847767 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 12:49:05.847917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847772 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 12:49:05.847917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847795 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 12:49:05.847917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.847800 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 12:49:05.849948 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.849933 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmsbn" Jun 10 12:49:05.851150 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.851137 2576 server.go:1268] "Started kubelet" Jun 10 12:49:05.851293 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.851235 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 12:49:05.851341 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.851318 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 12:49:05.851440 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.851271 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 12:49:05.852042 ip-10-0-128-84 systemd[1]: Started Kubernetes Kubelet. Jun 10 12:49:05.856361 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.856328 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 12:49:05.857326 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.857080 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 12:49:05.857437 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.857293 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 12:49:05.857777 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.857753 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 12:49:05.857904 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.857815 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmsbn" Jun 10 12:49:05.858733 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.858707 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 12:49:05.859599 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.859574 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 10 12:49:05.863192 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.862054 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-84.ec2.internal.18b7b924ea6a4efc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-84.ec2.internal,UID:ip-10-0-128-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-84.ec2.internal,},FirstTimestamp:2026-06-10 12:49:05.851117308 +0000 UTC m=+0.416099048,LastTimestamp:2026-06-10 12:49:05.851117308 +0000 UTC m=+0.416099048,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-84.ec2.internal,}" Jun 10 12:49:05.864646 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.864631 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 12:49:05.864719 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.864629 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 12:49:05.864786 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.864746 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:05.865404 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865372 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 12:49:05.865499 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865486 2576 factory.go:55] Registering systemd factory Jun 10 12:49:05.865581 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865570 2576 factory.go:223] Registration of the systemd container factory successfully Jun 10 12:49:05.865637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865490 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 12:49:05.865637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865620 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 12:49:05.865832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865754 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 10 12:49:05.865832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865761 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 10 12:49:05.866015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865853 2576 factory.go:153] Registering CRI-O factory Jun 10 12:49:05.866015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865863 2576 factory.go:223] Registration of the crio container factory successfully Jun 10 12:49:05.866015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865919 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 12:49:05.866015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865940 2576 factory.go:103] Registering Raw factory Jun 10 12:49:05.866015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.865953 2576 manager.go:1196] Started watching for new ooms in manager Jun 10 12:49:05.866329 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.866312 2576 manager.go:349] Starting recovery of all containers Jun 10 12:49:05.876653 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.876497 2576 manager.go:354] Recovery completed Jun 10 12:49:05.876897 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.876879 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:05.877901 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.877881 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 12:49:05.880765 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.880752 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:05.881104 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.881088 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-84.ec2.internal\" not found" node="ip-10-0-128-84.ec2.internal" Jun 10 12:49:05.882525 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.882515 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:05.882578 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.882542 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:05.882578 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.882557 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:05.883129 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.883116 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 12:49:05.883129 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.883126 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 12:49:05.883235 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.883141 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:49:05.883235 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.883190 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:05.884278 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.884263 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:05.884334 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.884293 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:05.884334 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.884314 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:05.884731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.884720 2576 policy_none.go:49] "None policy: Start" Jun 10 12:49:05.884764 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.884744 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 12:49:05.884764 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.884755 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 12:49:05.885926 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.885915 2576 policy_none.go:47] "Start" Jun 10 12:49:05.920947 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.920929 2576 manager.go:337] "Starting Device Plugin manager" Jun 10 12:49:05.921044 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.920961 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 12:49:05.921044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.920971 2576 server.go:87] "Starting device plugin registration server" Jun 10 12:49:05.921244 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.921224 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 12:49:05.921340 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.921246 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 12:49:05.921562 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.921464 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 12:49:05.921562 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.921547 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 12:49:05.921562 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.921562 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.922061 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.922115 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.938389 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.939507 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.939552 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.939582 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:05.939622 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 12:49:05.943637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:05.942082 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:06.021674 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.021627 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:06.023091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.023031 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:06.023091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.023062 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:06.023091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.023074 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:06.023264 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.023097 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.032242 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.032224 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.032299 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.032247 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-84.ec2.internal\": node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.040542 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.040523 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal"] Jun 10 12:49:06.040601 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.040578 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:06.041331 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.041317 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:06.041426 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.041359 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:06.041426 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.041375 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:06.042782 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.042770 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:06.043076 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.042870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.043076 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.042900 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:06.043443 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.043428 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:06.043519 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.043460 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:06.043519 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.043462 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:06.043519 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.043509 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:06.043656 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.043478 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:06.043656 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.043544 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:06.044832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.044815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.044914 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.044840 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:49:06.045719 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.045701 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:49:06.045807 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.045733 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:49:06.045807 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.045748 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:49:06.053392 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.053375 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.067286 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.067264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72554343ba862349bb81a92611207216-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal\" (UID: \"72554343ba862349bb81a92611207216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.067399 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.067298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72554343ba862349bb81a92611207216-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal\" (UID: \"72554343ba862349bb81a92611207216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.067399 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.067317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/deea8562724b7e4293feb704178fae5c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-84.ec2.internal\" (UID: \"deea8562724b7e4293feb704178fae5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.076206 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.076187 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-84.ec2.internal\" not found" node="ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.080879 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.080862 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-84.ec2.internal\" not found" node="ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.154310 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.154283 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.167642 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.167613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72554343ba862349bb81a92611207216-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal\" (UID: \"72554343ba862349bb81a92611207216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.167731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.167649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/deea8562724b7e4293feb704178fae5c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-84.ec2.internal\" (UID: \"deea8562724b7e4293feb704178fae5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.167731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.167667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72554343ba862349bb81a92611207216-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal\" (UID: \"72554343ba862349bb81a92611207216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.167731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.167707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72554343ba862349bb81a92611207216-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal\" (UID: \"72554343ba862349bb81a92611207216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.167731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.167710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72554343ba862349bb81a92611207216-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal\" (UID: \"72554343ba862349bb81a92611207216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.167874 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.167736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/deea8562724b7e4293feb704178fae5c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-84.ec2.internal\" (UID: \"deea8562724b7e4293feb704178fae5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.254965 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.254939 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.355955 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.355928 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.382448 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.382425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.386432 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.386301 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.456406 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.456366 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.556889 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.556859 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.657454 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.657421 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.758086 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.758045 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-84.ec2.internal\" not found" Jun 10 12:49:06.780304 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.780260 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:06.795327 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.795299 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 12:49:06.795522 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.795501 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:49:06.795581 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.795513 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:49:06.795581 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.795513 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:49:06.842589 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.842561 2576 apiserver.go:52] "Watching apiserver" Jun 10 12:49:06.861756 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.861733 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 12:49:06.862100 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.862078 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9","openshift-dns/node-resolver-4gfff","openshift-image-registry/node-ca-2l9wh","openshift-multus/multus-8fjws","openshift-multus/multus-additional-cni-plugins-27x5b","openshift-multus/network-metrics-daemon-f57dv","openshift-network-diagnostics/network-check-target-7jvtw","openshift-network-operator/iptables-alerter-fn762","kube-system/global-pull-secret-syncer-rxbfg","kube-system/konnectivity-agent-zfzkc","openshift-cluster-node-tuning-operator/tuned-56p5v","openshift-ovn-kubernetes/ovnkube-node-fdt6r"] Jun 10 12:49:06.863242 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.863218 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:44:05 +0000 UTC" deadline="2028-03-10 10:33:13.024593014 +0000 UTC" Jun 10 12:49:06.863291 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.863243 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15333h44m6.161352686s" Jun 10 12:49:06.863957 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.863944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.865431 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.865412 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 12:49:06.865431 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.865420 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.865577 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.865499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.867154 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.867136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:06.868723 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.868706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.870832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.870779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.871489 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871552 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-socket-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871552 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-registration-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871552 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871645 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-sys-fs\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871645 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3604a740-60af-4080-b48a-d4b2e564bea2-tmp-dir\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.871645 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-device-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871645 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlqg\" (UniqueName: \"kubernetes.io/projected/2af43f8c-1f6b-4334-b548-b41c86707a08-kube-api-access-vxlqg\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.871645 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3604a740-60af-4080-b48a-d4b2e564bea2-hosts-file\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.871786 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xs6\" (UniqueName: \"kubernetes.io/projected/3604a740-60af-4080-b48a-d4b2e564bea2-kube-api-access-78xs6\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.871997 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.871984 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:06.872067 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.872049 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:06.873415 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.873400 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:06.873491 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.873457 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:06.873532 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.873508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.873601 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.873547 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 12:49:06.873704 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.873665 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8jmwx\"" Jun 10 12:49:06.873757 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.873727 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.875568 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.875550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:06.877078 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.877057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:06.877181 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:06.877121 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:06.878468 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.878440 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.878689 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.878618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:06.879155 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.879133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.879275 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.879254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 12:49:06.879385 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.879330 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wdv9g\"" Jun 10 12:49:06.879619 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.879600 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.879707 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.879655 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.880212 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.880193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.880361 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.880247 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.880432 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.880409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.880589 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.880575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lmqtw\"" Jun 10 12:49:06.880783 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.880769 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.882119 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.882101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.882184 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.882145 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mtc5s\"" Jun 10 12:49:06.882184 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.882150 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 12:49:06.893515 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.893493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894536 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894566 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894587 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5bkz5\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894606 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894621 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mz7r\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894544 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 12:49:06.894726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894710 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.895154 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.894959 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4ltr9\"" Jun 10 12:49:06.895154 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 12:49:06.895154 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895017 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.895154 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895121 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 12:49:06.895286 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895252 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 12:49:06.895393 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895320 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 12:49:06.895393 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 12:49:06.895483 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nm6sp\"" Jun 10 12:49:06.895544 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895528 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p8jtm\"" Jun 10 12:49:06.895582 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895574 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 12:49:06.895664 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.895651 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 12:49:06.905416 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.905297 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:49:06.905416 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.905416 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" Jun 10 12:49:06.905803 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.905786 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:49:06.906052 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.906036 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal"] Jun 10 12:49:06.915843 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.915819 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbf7h" Jun 10 12:49:06.918012 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.917996 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:49:06.918203 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.918189 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal"] Jun 10 12:49:06.924487 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.924464 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbf7h" Jun 10 12:49:06.928164 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:06.928140 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72554343ba862349bb81a92611207216.slice/crio-f308052866ae1be73fb5e71dd702fb8c84270dba0488112eb8fb5294aed5b1a1 WatchSource:0}: Error finding container f308052866ae1be73fb5e71dd702fb8c84270dba0488112eb8fb5294aed5b1a1: Status 404 returned error can't find the container with id f308052866ae1be73fb5e71dd702fb8c84270dba0488112eb8fb5294aed5b1a1 Jun 10 12:49:06.929132 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:06.929093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeea8562724b7e4293feb704178fae5c.slice/crio-ac2150adf2836287b940e12076bfc0621b465cd2070937a19d2cbae214e50146 WatchSource:0}: Error finding container ac2150adf2836287b940e12076bfc0621b465cd2070937a19d2cbae214e50146: Status 404 returned error can't find the container with id ac2150adf2836287b940e12076bfc0621b465cd2070937a19d2cbae214e50146 Jun 10 12:49:06.935780 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.935762 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:49:06.943477 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.943426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" event={"ID":"deea8562724b7e4293feb704178fae5c","Type":"ContainerStarted","Data":"ac2150adf2836287b940e12076bfc0621b465cd2070937a19d2cbae214e50146"} Jun 10 12:49:06.945045 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.945021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" event={"ID":"72554343ba862349bb81a92611207216","Type":"ContainerStarted","Data":"f308052866ae1be73fb5e71dd702fb8c84270dba0488112eb8fb5294aed5b1a1"} Jun 10 12:49:06.946057 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.946041 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:06.966729 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.966710 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 12:49:06.972850 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-os-release\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.972923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpk9p\" (UniqueName: \"kubernetes.io/projected/8aacfa6c-b181-45bc-a2ef-569d99372340-kube-api-access-hpk9p\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.972923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpb2c\" (UniqueName: \"kubernetes.io/projected/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-kube-api-access-dpb2c\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:06.972923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59c6be98-fbab-4edf-8d64-90abfa398159-agent-certs\") pod \"konnectivity-agent-zfzkc\" (UID: \"59c6be98-fbab-4edf-8d64-90abfa398159\") " pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:06.972923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-etc-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.972986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovnkube-script-lib\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dada88db-0cd9-4016-bb87-f117c43fc853-kubelet-config\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-system-cni-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-kubernetes\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973071 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-lib-modules\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-os-release\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-systemd-units\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-cni-bin\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-systemd\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-slash\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovn-node-metrics-cert\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5k8k\" (UniqueName: \"kubernetes.io/projected/910f923d-7407-444a-8641-bfe4ff150248-kube-api-access-v5k8k\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.973280 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aacfa6c-b181-45bc-a2ef-569d99372340-cni-binary-copy\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-socket-dir-parent\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-conf-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87dwh\" (UniqueName: \"kubernetes.io/projected/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-kube-api-access-87dwh\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-run\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-host\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/910f923d-7407-444a-8641-bfe4ff150248-tmp\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-cnibin\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-cni-multus\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-var-lib-kubelet\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-node-log\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-cni-netd\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cnibin\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.973605 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3604a740-60af-4080-b48a-d4b2e564bea2-hosts-file\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-kubelet\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-hostroot\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-etc-kubernetes\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-host-slash\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3604a740-60af-4080-b48a-d4b2e564bea2-hosts-file\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-kubelet\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68a65828-4c10-4af2-9ce8-f8a1549c6ace-host\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-registration-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-daemon-config\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-registration-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-iptables-alerter-script\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dada88db-0cd9-4016-bb87-f117c43fc853-dbus\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-systemd\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlqg\" (UniqueName: \"kubernetes.io/projected/2af43f8c-1f6b-4334-b548-b41c86707a08-kube-api-access-vxlqg\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xs6\" (UniqueName: \"kubernetes.io/projected/3604a740-60af-4080-b48a-d4b2e564bea2-kube-api-access-78xs6\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.974127 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59c6be98-fbab-4edf-8d64-90abfa398159-konnectivity-ca\") pod \"konnectivity-agent-zfzkc\" (UID: \"59c6be98-fbab-4edf-8d64-90abfa398159\") " pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-env-overrides\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.973985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-socket-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3604a740-60af-4080-b48a-d4b2e564bea2-tmp-dir\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-k8s-cni-cncf-io\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-var-lib-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-device-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-device-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-multus-certs\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-socket-dir\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68a65828-4c10-4af2-9ce8-f8a1549c6ace-serviceca\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovnkube-config\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-system-cni-dir\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-cni-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.974894 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-modprobe-d\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-sys-fs\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3604a740-60af-4080-b48a-d4b2e564bea2-tmp-dir\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2af43f8c-1f6b-4334-b548-b41c86707a08-sys-fs\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-netns\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysconfig\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-sys\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/910f923d-7407-444a-8641-bfe4ff150248-etc-tuned\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmsrl\" (UniqueName: \"kubernetes.io/projected/68a65828-4c10-4af2-9ce8-f8a1549c6ace-kube-api-access-nmsrl\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqn2\" (UniqueName: \"kubernetes.io/projected/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-kube-api-access-qcqn2\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-run-netns\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysctl-d\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysctl-conf\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-ovn\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-log-socket\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.975383 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-cni-bin\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.975828 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.975828 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.974759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kct4\" (UniqueName: \"kubernetes.io/projected/5b7caeac-91b0-4307-9d5f-efda8b67df5f-kube-api-access-4kct4\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:06.985498 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.985474 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 12:49:06.988364 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.988332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlqg\" (UniqueName: \"kubernetes.io/projected/2af43f8c-1f6b-4334-b548-b41c86707a08-kube-api-access-vxlqg\") pod \"aws-ebs-csi-driver-node-4rpf9\" (UID: \"2af43f8c-1f6b-4334-b548-b41c86707a08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:06.988464 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:06.988333 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xs6\" (UniqueName: \"kubernetes.io/projected/3604a740-60af-4080-b48a-d4b2e564bea2-kube-api-access-78xs6\") pod \"node-resolver-4gfff\" (UID: \"3604a740-60af-4080-b48a-d4b2e564bea2\") " pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:07.074983 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.074950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.074983 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.074983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-slash\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovn-node-metrics-cert\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5k8k\" (UniqueName: \"kubernetes.io/projected/910f923d-7407-444a-8641-bfe4ff150248-kube-api-access-v5k8k\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075072 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-slash\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aacfa6c-b181-45bc-a2ef-569d99372340-cni-binary-copy\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-socket-dir-parent\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-conf-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dwh\" (UniqueName: \"kubernetes.io/projected/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-kube-api-access-87dwh\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-run\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-host\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075215 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/910f923d-7407-444a-8641-bfe4ff150248-tmp\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-cnibin\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-socket-dir-parent\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-cni-multus\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-var-lib-kubelet\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-run\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-host\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-conf-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075417 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-cni-multus\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-cnibin\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-var-lib-kubelet\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.075498 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-node-log\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-cni-netd\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.075711 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.075564 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:07.575543173 +0000 UTC m=+2.140524901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-cni-netd\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cnibin\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-node-log\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-kubelet\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-hostroot\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-etc-kubernetes\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075668 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aacfa6c-b181-45bc-a2ef-569d99372340-cni-binary-copy\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-host-slash\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-kubelet\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cnibin\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-etc-kubernetes\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68a65828-4c10-4af2-9ce8-f8a1549c6ace-host\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-kubelet\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-hostroot\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68a65828-4c10-4af2-9ce8-f8a1549c6ace-host\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.076241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-daemon-config\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-host-slash\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-kubelet\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.075907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-iptables-alerter-script\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dada88db-0cd9-4016-bb87-f117c43fc853-dbus\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.076260 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-systemd\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.076361 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:49:07.576329852 +0000 UTC m=+2.141311603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-systemd\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59c6be98-fbab-4edf-8d64-90abfa398159-konnectivity-ca\") pod \"konnectivity-agent-zfzkc\" (UID: \"59c6be98-fbab-4edf-8d64-90abfa398159\") " pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dada88db-0cd9-4016-bb87-f117c43fc853-dbus\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-env-overrides\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-k8s-cni-cncf-io\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-var-lib-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-multus-certs\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68a65828-4c10-4af2-9ce8-f8a1549c6ace-serviceca\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovnkube-config\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-system-cni-dir\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-cni-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-modprobe-d\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-netns\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysconfig\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-iptables-alerter-script\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-sys\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-daemon-config\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-multus-certs\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-env-overrides\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.076851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-sys\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59c6be98-fbab-4edf-8d64-90abfa398159-konnectivity-ca\") pod \"konnectivity-agent-zfzkc\" (UID: \"59c6be98-fbab-4edf-8d64-90abfa398159\") " pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-k8s-cni-cncf-io\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.077805 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-run-netns\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysconfig\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-multus-cni-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-system-cni-dir\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077588 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-var-lib-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/910f923d-7407-444a-8641-bfe4ff150248-etc-tuned\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-modprobe-d\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmsrl\" (UniqueName: \"kubernetes.io/projected/68a65828-4c10-4af2-9ce8-f8a1549c6ace-kube-api-access-nmsrl\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovn-node-metrics-cert\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/68a65828-4c10-4af2-9ce8-f8a1549c6ace-serviceca\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.077781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqn2\" (UniqueName: \"kubernetes.io/projected/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-kube-api-access-qcqn2\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-run-netns\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysctl-d\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysctl-conf\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-ovn\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-log-socket\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-cni-bin\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.078649 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kct4\" (UniqueName: \"kubernetes.io/projected/5b7caeac-91b0-4307-9d5f-efda8b67df5f-kube-api-access-4kct4\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-os-release\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpk9p\" (UniqueName: \"kubernetes.io/projected/8aacfa6c-b181-45bc-a2ef-569d99372340-kube-api-access-hpk9p\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpb2c\" (UniqueName: \"kubernetes.io/projected/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-kube-api-access-dpb2c\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovnkube-config\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59c6be98-fbab-4edf-8d64-90abfa398159-agent-certs\") pod \"konnectivity-agent-zfzkc\" (UID: \"59c6be98-fbab-4edf-8d64-90abfa398159\") " pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-etc-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovnkube-script-lib\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dada88db-0cd9-4016-bb87-f117c43fc853-kubelet-config\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-system-cni-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-kubernetes\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-lib-modules\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-os-release\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-systemd-units\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.079395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-cni-bin\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-systemd\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.078963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-systemd\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dada88db-0cd9-4016-bb87-f117c43fc853-kubelet-config\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-run-netns\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysctl-d\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-lib-modules\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079212 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/910f923d-7407-444a-8641-bfe4ff150248-tmp\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-sysctl-conf\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-log-socket\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-cni-bin\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-systemd-units\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-os-release\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910f923d-7407-444a-8641-bfe4ff150248-etc-kubernetes\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-ovn\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-host-var-lib-cni-bin\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.080191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-etc-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.081025 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b7caeac-91b0-4307-9d5f-efda8b67df5f-run-openvswitch\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.081025 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.079851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b7caeac-91b0-4307-9d5f-efda8b67df5f-ovnkube-script-lib\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.081877 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.081207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-os-release\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.081988 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.081960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aacfa6c-b181-45bc-a2ef-569d99372340-system-cni-dir\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.082472 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.082453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59c6be98-fbab-4edf-8d64-90abfa398159-agent-certs\") pod \"konnectivity-agent-zfzkc\" (UID: \"59c6be98-fbab-4edf-8d64-90abfa398159\") " pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:07.083184 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.083169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/910f923d-7407-444a-8641-bfe4ff150248-etc-tuned\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.089224 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.089202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87dwh\" (UniqueName: \"kubernetes.io/projected/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-kube-api-access-87dwh\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:07.090695 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.090671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5k8k\" (UniqueName: \"kubernetes.io/projected/910f923d-7407-444a-8641-bfe4ff150248-kube-api-access-v5k8k\") pod \"tuned-56p5v\" (UID: \"910f923d-7407-444a-8641-bfe4ff150248\") " pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.092073 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.092051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpk9p\" (UniqueName: \"kubernetes.io/projected/8aacfa6c-b181-45bc-a2ef-569d99372340-kube-api-access-hpk9p\") pod \"multus-8fjws\" (UID: \"8aacfa6c-b181-45bc-a2ef-569d99372340\") " pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.092245 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.092228 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:07.092317 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.092252 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:07.092317 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.092274 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:07.092441 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.092341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:49:07.592323118 +0000 UTC m=+2.157304870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:07.092515 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.092443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpb2c\" (UniqueName: \"kubernetes.io/projected/3c932d8c-37cc-49cd-9e40-5df4adf3c01e-kube-api-access-dpb2c\") pod \"iptables-alerter-fn762\" (UID: \"3c932d8c-37cc-49cd-9e40-5df4adf3c01e\") " pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.094187 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.094162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmsrl\" (UniqueName: \"kubernetes.io/projected/68a65828-4c10-4af2-9ce8-f8a1549c6ace-kube-api-access-nmsrl\") pod \"node-ca-2l9wh\" (UID: \"68a65828-4c10-4af2-9ce8-f8a1549c6ace\") " pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.094508 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.094488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqn2\" (UniqueName: \"kubernetes.io/projected/7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf-kube-api-access-qcqn2\") pod \"multus-additional-cni-plugins-27x5b\" (UID: \"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf\") " pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.095303 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.095288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kct4\" (UniqueName: \"kubernetes.io/projected/5b7caeac-91b0-4307-9d5f-efda8b67df5f-kube-api-access-4kct4\") pod \"ovnkube-node-fdt6r\" (UID: \"5b7caeac-91b0-4307-9d5f-efda8b67df5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.189283 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.189186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" Jun 10 12:49:07.197822 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.197797 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af43f8c_1f6b_4334_b548_b41c86707a08.slice/crio-fc25108bd693fc43fa8b61fa7f2cb3df6552592c8abca34e440cb893b50fef10 WatchSource:0}: Error finding container fc25108bd693fc43fa8b61fa7f2cb3df6552592c8abca34e440cb893b50fef10: Status 404 returned error can't find the container with id fc25108bd693fc43fa8b61fa7f2cb3df6552592c8abca34e440cb893b50fef10 Jun 10 12:49:07.205877 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.205854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gfff" Jun 10 12:49:07.213115 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.213093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3604a740_60af_4080_b48a_d4b2e564bea2.slice/crio-17c0a143f459994f89d67f04cd23bb60da25d14e1a009f8fb098e015bfc5ec5f WatchSource:0}: Error finding container 17c0a143f459994f89d67f04cd23bb60da25d14e1a009f8fb098e015bfc5ec5f: Status 404 returned error can't find the container with id 17c0a143f459994f89d67f04cd23bb60da25d14e1a009f8fb098e015bfc5ec5f Jun 10 12:49:07.227454 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.227431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2l9wh" Jun 10 12:49:07.235227 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.235199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a65828_4c10_4af2_9ce8_f8a1549c6ace.slice/crio-c2c19a8a9338f0dfe4c5a8b2c76667c2774dd0d8ef489ee968c6ec99c1092c05 WatchSource:0}: Error finding container c2c19a8a9338f0dfe4c5a8b2c76667c2774dd0d8ef489ee968c6ec99c1092c05: Status 404 returned error can't find the container with id c2c19a8a9338f0dfe4c5a8b2c76667c2774dd0d8ef489ee968c6ec99c1092c05 Jun 10 12:49:07.238624 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.238600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8fjws" Jun 10 12:49:07.245668 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.245484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-27x5b" Jun 10 12:49:07.245795 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.245775 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aacfa6c_b181_45bc_a2ef_569d99372340.slice/crio-db66f2b0d67d54c195b1cc02b747f5e8bfa3b88b2cf25a15be0da4632bbbfe06 WatchSource:0}: Error finding container db66f2b0d67d54c195b1cc02b747f5e8bfa3b88b2cf25a15be0da4632bbbfe06: Status 404 returned error can't find the container with id db66f2b0d67d54c195b1cc02b747f5e8bfa3b88b2cf25a15be0da4632bbbfe06 Jun 10 12:49:07.251980 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.251959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fn762" Jun 10 12:49:07.254209 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.254146 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbfc670_cfc7_4da1_95d0_5cd37c23f4bf.slice/crio-ae8dff284d51365bf6ece81e23e68bb0adbc98a43e3b671a37d38560ac803d6e WatchSource:0}: Error finding container ae8dff284d51365bf6ece81e23e68bb0adbc98a43e3b671a37d38560ac803d6e: Status 404 returned error can't find the container with id ae8dff284d51365bf6ece81e23e68bb0adbc98a43e3b671a37d38560ac803d6e Jun 10 12:49:07.258984 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.258966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:07.259290 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.259266 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c932d8c_37cc_49cd_9e40_5df4adf3c01e.slice/crio-2be30990302ba1dfc9b6a9dc4c3850b7462972d9e18f09a048b3aae7620b5f11 WatchSource:0}: Error finding container 2be30990302ba1dfc9b6a9dc4c3850b7462972d9e18f09a048b3aae7620b5f11: Status 404 returned error can't find the container with id 2be30990302ba1dfc9b6a9dc4c3850b7462972d9e18f09a048b3aae7620b5f11 Jun 10 12:49:07.263796 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.263778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-56p5v" Jun 10 12:49:07.268186 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.268167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:07.268387 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.268360 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c6be98_fbab_4edf_8d64_90abfa398159.slice/crio-bc5903cc02a77d6f1897b30827702daf50d3e6d3eff84ac1afdfe59292ca0233 WatchSource:0}: Error finding container bc5903cc02a77d6f1897b30827702daf50d3e6d3eff84ac1afdfe59292ca0233: Status 404 returned error can't find the container with id bc5903cc02a77d6f1897b30827702daf50d3e6d3eff84ac1afdfe59292ca0233 Jun 10 12:49:07.272432 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.272408 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910f923d_7407_444a_8641_bfe4ff150248.slice/crio-f20c3233f10d798edd610560ace7c14cbaaef477f0080cad323ceafff4f64604 WatchSource:0}: Error finding container f20c3233f10d798edd610560ace7c14cbaaef477f0080cad323ceafff4f64604: Status 404 returned error can't find the container with id f20c3233f10d798edd610560ace7c14cbaaef477f0080cad323ceafff4f64604 Jun 10 12:49:07.277842 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:07.277823 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7caeac_91b0_4307_9d5f_efda8b67df5f.slice/crio-10f26f6a8ce6276142aa7670db579e60f25b135119fc0082a718ef04ae5975dc WatchSource:0}: Error finding container 10f26f6a8ce6276142aa7670db579e60f25b135119fc0082a718ef04ae5975dc: Status 404 returned error can't find the container with id 10f26f6a8ce6276142aa7670db579e60f25b135119fc0082a718ef04ae5975dc Jun 10 12:49:07.582561 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.582527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:07.582724 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.582580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:07.582817 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.582724 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:07.582817 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.582778 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:49:08.582762452 +0000 UTC m=+3.147744189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:07.583251 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.583159 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:07.583251 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.583213 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:08.58319699 +0000 UTC m=+3.148178752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:07.684504 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.683865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:07.684504 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.684031 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:07.684504 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.684052 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:07.684504 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.684067 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:07.684504 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:07.684121 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:49:08.684102842 +0000 UTC m=+3.249084591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:07.927910 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.927738 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:44:06 +0000 UTC" deadline="2027-11-13 13:34:29.248419647 +0000 UTC" Jun 10 12:49:07.927910 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.927812 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12504h45m21.320612791s" Jun 10 12:49:07.936119 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.935917 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:07.956913 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.956878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"10f26f6a8ce6276142aa7670db579e60f25b135119fc0082a718ef04ae5975dc"} Jun 10 12:49:07.969110 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.969074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-56p5v" event={"ID":"910f923d-7407-444a-8641-bfe4ff150248","Type":"ContainerStarted","Data":"f20c3233f10d798edd610560ace7c14cbaaef477f0080cad323ceafff4f64604"} Jun 10 12:49:07.974438 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.972325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fn762" event={"ID":"3c932d8c-37cc-49cd-9e40-5df4adf3c01e","Type":"ContainerStarted","Data":"2be30990302ba1dfc9b6a9dc4c3850b7462972d9e18f09a048b3aae7620b5f11"} Jun 10 12:49:07.974438 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.973964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerStarted","Data":"ae8dff284d51365bf6ece81e23e68bb0adbc98a43e3b671a37d38560ac803d6e"} Jun 10 12:49:07.985924 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:07.985894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8fjws" event={"ID":"8aacfa6c-b181-45bc-a2ef-569d99372340","Type":"ContainerStarted","Data":"db66f2b0d67d54c195b1cc02b747f5e8bfa3b88b2cf25a15be0da4632bbbfe06"} Jun 10 12:49:08.003463 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.003431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2l9wh" event={"ID":"68a65828-4c10-4af2-9ce8-f8a1549c6ace","Type":"ContainerStarted","Data":"c2c19a8a9338f0dfe4c5a8b2c76667c2774dd0d8ef489ee968c6ec99c1092c05"} Jun 10 12:49:08.009859 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.009831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfzkc" event={"ID":"59c6be98-fbab-4edf-8d64-90abfa398159","Type":"ContainerStarted","Data":"bc5903cc02a77d6f1897b30827702daf50d3e6d3eff84ac1afdfe59292ca0233"} Jun 10 12:49:08.016510 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.016449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gfff" event={"ID":"3604a740-60af-4080-b48a-d4b2e564bea2","Type":"ContainerStarted","Data":"17c0a143f459994f89d67f04cd23bb60da25d14e1a009f8fb098e015bfc5ec5f"} Jun 10 12:49:08.025513 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.025439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" event={"ID":"2af43f8c-1f6b-4334-b548-b41c86707a08","Type":"ContainerStarted","Data":"fc25108bd693fc43fa8b61fa7f2cb3df6552592c8abca34e440cb893b50fef10"} Jun 10 12:49:08.183463 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.182010 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:08.591498 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.591463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:08.591674 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.591513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:08.591674 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.591626 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:08.591808 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.591697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:10.59167816 +0000 UTC m=+5.156659894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:08.592027 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.591627 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:08.592091 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.592072 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:49:10.592057032 +0000 UTC m=+5.157038764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:08.692770 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.692733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:08.692936 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.692925 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:08.693011 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.692947 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:08.693011 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.692960 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:08.693116 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.693023 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:49:10.693004968 +0000 UTC m=+5.257986709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:08.928376 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.928271 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:44:06 +0000 UTC" deadline="2028-02-03 07:50:54.958779377 +0000 UTC" Jun 10 12:49:08.928376 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.928314 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14467h1m46.030470315s" Jun 10 12:49:08.940601 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.940575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:08.940601 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.940596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:08.940797 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.940712 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:08.940855 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.940804 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:08.940904 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:08.940862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:08.940971 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:08.940953 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:09.915137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:09.915101 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:49:10.609496 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:10.609416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:10.609496 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:10.609485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:10.609923 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.609621 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:10.609923 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.609681 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:49:14.609661412 +0000 UTC m=+9.174643143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:10.610083 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.610068 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:10.610157 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.610145 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:14.610102136 +0000 UTC m=+9.175083882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:10.710673 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:10.710635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:10.710912 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.710892 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:10.710998 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.710918 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:10.710998 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.710932 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:10.710998 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.710989 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:49:14.710971416 +0000 UTC m=+9.275953162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:10.940444 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:10.940366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:10.940600 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.940496 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:10.940600 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:10.940573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:10.940726 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.940664 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:10.940726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:10.940713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:10.940828 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:10.940777 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:12.940302 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:12.940257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:12.940302 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:12.940307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:12.940744 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:12.940309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:12.940744 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:12.940448 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:12.940744 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:12.940582 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:12.940744 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:12.940647 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:14.644374 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:14.643764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:14.644374 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:14.643831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:14.644374 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.644022 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:14.644374 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.644087 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:49:22.644067684 +0000 UTC m=+17.209049417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:14.644981 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.644584 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:14.644981 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.644647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:22.644622641 +0000 UTC m=+17.209604370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:14.745373 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:14.745307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:14.746203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.745732 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:14.746203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.745763 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:14.746203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.745778 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:14.746203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.745853 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:49:22.745833357 +0000 UTC m=+17.310815109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:14.940371 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:14.940278 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:14.940530 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.940450 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:14.940855 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:14.940834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:14.940951 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.940932 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:14.941016 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:14.940991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:14.941070 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:14.941054 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:16.940848 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:16.940811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:16.940848 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:16.940840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:16.941381 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:16.940818 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:16.941381 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:16.940962 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:16.941381 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:16.941027 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:16.941381 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:16.941083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:18.940133 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:18.940101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:18.940133 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:18.940128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:18.940133 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:18.940102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:18.940695 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:18.940243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:18.940695 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:18.940384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:18.940695 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:18.940466 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:20.940719 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:20.940691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:20.940719 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:20.940723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:20.941151 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:20.940690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:20.941151 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:20.940814 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:20.941151 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:20.940868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:20.941151 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:20.940970 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:22.705944 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:22.705910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:22.705944 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:22.705950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:22.706512 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.706099 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:22.706512 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.706141 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:22.706512 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.706180 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:38.706157944 +0000 UTC m=+33.271139685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:22.706512 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.706202 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:49:38.706191247 +0000 UTC m=+33.271172974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:22.806597 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:22.806566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:22.806771 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.806698 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:22.806771 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.806713 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:22.806771 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.806725 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:22.806897 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.806788 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:49:38.8067698 +0000 UTC m=+33.371751530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:22.940584 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:22.940365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:22.940584 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:22.940385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:22.940584 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.940502 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:22.940584 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:22.940385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:22.940584 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.940580 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:22.940929 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:22.940643 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:24.940768 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:24.940737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:24.941198 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:24.940740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:24.941198 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:24.940845 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:24.941198 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:24.940870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:24.941198 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:24.940939 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:24.941198 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:24.941012 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:26.939826 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:26.939783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:26.940203 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:26.939783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:26.940203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:26.939908 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:26.940203 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:26.939805 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:26.940203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:26.939970 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:26.940203 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:26.940042 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:28.076364 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076569 2576 generic.go:356] "Generic (PLEG): container finished" podID="5b7caeac-91b0-4307-9d5f-efda8b67df5f" containerID="68318163292caed64bb71039581932623ddebf231f23f1611a6aed52de2a0923" exitCode=1 Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"95c53f338fc8478782f16bb3a7289a3ee489f5aeed7be2267f39d4f267b9bdda"} Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"33bdc914277b7f236f0562e7d5fe55711c9cef458b1f146f8bf756eca9f93186"} Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"435cfce6274ee2051af02ebd5f899f2b62a9351136494f135947babc689c88d5"} Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"708dc8ff0d19b951cd0a64f8ad41c4a4143dea047aef42bf91091f591d95c101"} Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerDied","Data":"68318163292caed64bb71039581932623ddebf231f23f1611a6aed52de2a0923"} Jun 10 12:49:28.077047 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.076826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"e97fc1f93d34c4a7332ba2f988eb7939b99ea8aa180dff3ae24a49eb0bb0e24a"} Jun 10 12:49:28.078021 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.077999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-56p5v" event={"ID":"910f923d-7407-444a-8641-bfe4ff150248","Type":"ContainerStarted","Data":"452e389d7df7987168ab74f48a6ea898cf529ff6205ef2da3c91206adfa747ea"} Jun 10 12:49:28.079414 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.079391 2576 generic.go:356] "Generic (PLEG): container finished" podID="7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf" containerID="86456b2c3ff378db868bb6cd9cea8797aec2f9a7934069ca2137d8948e744121" exitCode=0 Jun 10 12:49:28.079496 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.079460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerDied","Data":"86456b2c3ff378db868bb6cd9cea8797aec2f9a7934069ca2137d8948e744121"} Jun 10 12:49:28.080931 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.080904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8fjws" event={"ID":"8aacfa6c-b181-45bc-a2ef-569d99372340","Type":"ContainerStarted","Data":"ccac0bcfe48bb04edcb89fa6924cf3bbc31a3d53d0a26ec49851790a874dd454"} Jun 10 12:49:28.082335 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.082305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2l9wh" event={"ID":"68a65828-4c10-4af2-9ce8-f8a1549c6ace","Type":"ContainerStarted","Data":"a2e22fa63278abfde9d63ddac61962dac7c71de6be1792e3ef6c9e46276ff623"} Jun 10 12:49:28.083616 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.083590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" event={"ID":"deea8562724b7e4293feb704178fae5c","Type":"ContainerStarted","Data":"cff5b7880d6bfeb381a8c4548f5bf873acf5d331fe500c67ccaae6549b62358b"} Jun 10 12:49:28.084893 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.084868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfzkc" event={"ID":"59c6be98-fbab-4edf-8d64-90abfa398159","Type":"ContainerStarted","Data":"c12f178a30a9bf5be5976be348511a0a3dcf9b4e14bef65bbd26fa9402fe6619"} Jun 10 12:49:28.086169 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.086145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gfff" event={"ID":"3604a740-60af-4080-b48a-d4b2e564bea2","Type":"ContainerStarted","Data":"77635b52f03b5826d135edc3ee21b0dc7f0442aefe9f0ce5c3d7c1eb73c8a0d3"} Jun 10 12:49:28.087444 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.087424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" event={"ID":"2af43f8c-1f6b-4334-b548-b41c86707a08","Type":"ContainerStarted","Data":"ddb20bfc32948f792082cc1fc16f21130551ac0051b09091cd535ffa1c0d0557"} Jun 10 12:49:28.088681 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.088663 2576 generic.go:356] "Generic (PLEG): container finished" podID="72554343ba862349bb81a92611207216" containerID="676ac59daeca191604c1aae4f1b5a3329c7f69036be6a82ab7a3d70876219073" exitCode=0 Jun 10 12:49:28.088763 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.088688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" event={"ID":"72554343ba862349bb81a92611207216","Type":"ContainerDied","Data":"676ac59daeca191604c1aae4f1b5a3329c7f69036be6a82ab7a3d70876219073"} Jun 10 12:49:28.114097 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.114047 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-56p5v" podStartSLOduration=2.407634734 podStartE2EDuration="22.114027836s" totalImagesPullingTime="19.706393102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:28.099203204 +0000 UTC m=+22.664184955" watchObservedRunningTime="2026-06-10 12:49:28.114027836 +0000 UTC m=+22.679009586" Jun 10 12:49:28.130608 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.130496 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-84.ec2.internal" podStartSLOduration=22.130483708 podStartE2EDuration="22.130483708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:28.130157716 +0000 UTC m=+22.695139466" watchObservedRunningTime="2026-06-10 12:49:28.130483708 +0000 UTC m=+22.695465457" Jun 10 12:49:28.147912 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.147873 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4gfff" podStartSLOduration=2.383408529 podStartE2EDuration="22.147859938s" totalImagesPullingTime="19.764451409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:28.147128787 +0000 UTC m=+22.712110563" watchObservedRunningTime="2026-06-10 12:49:28.147859938 +0000 UTC m=+22.712841688" Jun 10 12:49:28.163431 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.163384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2l9wh" podStartSLOduration=2.422717608 podStartE2EDuration="22.163368104s" totalImagesPullingTime="19.740650496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:28.163266791 +0000 UTC m=+22.728248542" watchObservedRunningTime="2026-06-10 12:49:28.163368104 +0000 UTC m=+22.728349849" Jun 10 12:49:28.181098 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.181059 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8fjws" podStartSLOduration=1.87604047 podStartE2EDuration="22.181045746s" totalImagesPullingTime="20.305005276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:28.180740868 +0000 UTC m=+22.745722619" watchObservedRunningTime="2026-06-10 12:49:28.181045746 +0000 UTC m=+22.746027496" Jun 10 12:49:28.940044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.940022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:28.940194 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.940120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:28.940194 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:28.940124 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:28.940194 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:28.940127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:28.940382 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:28.940236 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:28.940382 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:28.940256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:29.098318 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.098276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" event={"ID":"72554343ba862349bb81a92611207216","Type":"ContainerStarted","Data":"92e2768efec0953b794797b8f748337d30aa43c83a26046aa1146fa3ca4a1c76"} Jun 10 12:49:29.100256 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.100227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fn762" event={"ID":"3c932d8c-37cc-49cd-9e40-5df4adf3c01e","Type":"ContainerStarted","Data":"795a212738ca67eb344064d79b8ac35f1d94591855c61a3975018d83c917d0eb"} Jun 10 12:49:29.104726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.104702 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 12:49:29.118702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.118660 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zfzkc" podStartSLOduration=11.87768379 podStartE2EDuration="23.118646793s" totalImagesPullingTime="11.240963003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:28.2224596 +0000 UTC m=+22.787441361" watchObservedRunningTime="2026-06-10 12:49:29.118646793 +0000 UTC m=+23.683628547" Jun 10 12:49:29.118993 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.118958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-84.ec2.internal" podStartSLOduration=23.118947478 podStartE2EDuration="23.118947478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:29.118788221 +0000 UTC m=+23.683769961" watchObservedRunningTime="2026-06-10 12:49:29.118947478 +0000 UTC m=+23.683929229" Jun 10 12:49:29.137277 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.137229 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fn762" podStartSLOduration=3.418503482 podStartE2EDuration="23.137213774s" totalImagesPullingTime="19.718710292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:29.137033005 +0000 UTC m=+23.702014755" watchObservedRunningTime="2026-06-10 12:49:29.137213774 +0000 UTC m=+23.702195524" Jun 10 12:49:29.936163 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.936042 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T12:49:29.104722014Z","UUID":"2d2cdc28-c64f-42c4-8d38-bdcd9f613cb4","Handler":null,"Name":"","Endpoint":""} Jun 10 12:49:29.937547 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.937522 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 12:49:29.937654 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:29.937573 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 12:49:30.104528 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:30.104242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" event={"ID":"2af43f8c-1f6b-4334-b548-b41c86707a08","Type":"ContainerStarted","Data":"6cde30250a95f2825529fe6063007fac03b353b8c6c45eed1cba70dd3709a478"} Jun 10 12:49:30.108044 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:30.108024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:49:30.108928 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:30.108517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"2c3d38ccdb7aead340786eed5cb4d87f5632d091ba99e30f9b92f5208cfc0f4e"} Jun 10 12:49:30.940016 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:30.939985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:30.940016 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:30.940013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:30.940291 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:30.939984 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:30.940291 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:30.940115 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:30.940291 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:30.940196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:30.940291 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:30.940272 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:31.113782 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:31.113746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" event={"ID":"2af43f8c-1f6b-4334-b548-b41c86707a08","Type":"ContainerStarted","Data":"7360bc2e15e9a510667d2592776d34503a8afaab0ad35d5b2bd9d0bdf238154e"} Jun 10 12:49:31.137470 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:31.137423 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rpf9" podStartSLOduration=3.23010851 podStartE2EDuration="25.137401596s" totalImagesPullingTime="21.907293086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:31.137323068 +0000 UTC m=+25.702304820" watchObservedRunningTime="2026-06-10 12:49:31.137401596 +0000 UTC m=+25.702383348" Jun 10 12:49:31.421896 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:31.421857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:31.422595 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:31.422569 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:32.116452 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:32.116428 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:32.116923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:32.116908 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfzkc" Jun 10 12:49:32.940395 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:32.940186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:32.940591 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:32.940186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:32.940591 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:32.940471 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:32.940591 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:32.940186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:32.940591 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:32.940549 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:32.940741 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:32.940593 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:33.121388 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.121365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:49:33.121776 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.121719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"925b7c0e2a99e13042ff795926bf061ae210e0c98a96e9f2b508fae46fca7c12"} Jun 10 12:49:33.122000 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.121971 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:33.122091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.122040 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:33.122191 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.122177 2576 scope.go:117] "RemoveContainer" containerID="68318163292caed64bb71039581932623ddebf231f23f1611a6aed52de2a0923" Jun 10 12:49:33.123786 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.123766 2576 generic.go:356] "Generic (PLEG): container finished" podID="7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf" containerID="e63f1d1afdc07b9848824816ffd7216573db0ab1f3408fcfa9b69ad0218f9771" exitCode=0 Jun 10 12:49:33.123891 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.123845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerDied","Data":"e63f1d1afdc07b9848824816ffd7216573db0ab1f3408fcfa9b69ad0218f9771"} Jun 10 12:49:33.138305 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:33.138283 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:34.130991 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.130952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:49:34.131526 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.131499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" event={"ID":"5b7caeac-91b0-4307-9d5f-efda8b67df5f","Type":"ContainerStarted","Data":"e254822a8770fb9f3a133e50feeacf583dcca749f0b3f6f8107565c2ab1271e3"} Jun 10 12:49:34.132488 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.131935 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:34.148798 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.148775 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:49:34.165081 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.165038 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" podStartSLOduration=8.421888054 podStartE2EDuration="28.164999273s" totalImagesPullingTime="19.743111219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:34.16479248 +0000 UTC m=+28.729774257" watchObservedRunningTime="2026-06-10 12:49:34.164999273 +0000 UTC m=+28.729981025" Jun 10 12:49:34.307819 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.307638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jvtw"] Jun 10 12:49:34.307985 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.307916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:34.308040 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:34.307998 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:34.310776 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.310749 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxbfg"] Jun 10 12:49:34.311015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.310860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:34.311015 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:34.310970 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:34.311486 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.311463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f57dv"] Jun 10 12:49:34.311580 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:34.311551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:34.311657 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:34.311636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:35.136239 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:35.136201 2576 generic.go:356] "Generic (PLEG): container finished" podID="7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf" containerID="0534817f0ee849f124370e8526fbf700fb1903a4a479bead1688d339efe52e14" exitCode=0 Jun 10 12:49:35.136723 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:35.136285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerDied","Data":"0534817f0ee849f124370e8526fbf700fb1903a4a479bead1688d339efe52e14"} Jun 10 12:49:35.940746 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:35.940717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:35.940939 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:35.940814 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:35.940939 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:35.940845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:35.941060 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:35.940959 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:35.941060 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:35.940991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:35.941151 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:35.941082 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:37.143218 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:37.143179 2576 generic.go:356] "Generic (PLEG): container finished" podID="7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf" containerID="7da507442eaae1d1347d1b86f269246cd36646c4d8024c19bb8ac30742da9d67" exitCode=0 Jun 10 12:49:37.143906 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:37.143234 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerDied","Data":"7da507442eaae1d1347d1b86f269246cd36646c4d8024c19bb8ac30742da9d67"} Jun 10 12:49:37.940738 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:37.940705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:37.940930 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:37.940705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:37.940930 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:37.940832 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:37.941039 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:37.940939 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:37.941039 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:37.940711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:37.941134 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:37.941053 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:38.727905 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:38.727812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:38.727905 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:38.727862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:38.728472 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.727985 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:38.728472 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.727989 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:38.728472 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.728045 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:50:10.728025512 +0000 UTC m=+65.293007262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:49:38.728472 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.728059 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret podName:dada88db-0cd9-4016-bb87-f117c43fc853 nodeName:}" failed. No retries permitted until 2026-06-10 12:50:10.728053369 +0000 UTC m=+65.293035096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret") pod "global-pull-secret-syncer-rxbfg" (UID: "dada88db-0cd9-4016-bb87-f117c43fc853") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:49:38.828675 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:38.828640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:38.828835 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.828801 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:49:38.828835 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.828821 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:49:38.828835 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.828832 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6bmlw for pod openshift-network-diagnostics/network-check-target-7jvtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:38.828953 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:38.828899 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw podName:e48af8d5-50a8-4242-9220-daa36c82192b nodeName:}" failed. No retries permitted until 2026-06-10 12:50:10.82888061 +0000 UTC m=+65.393862341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bmlw" (UniqueName: "kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw") pod "network-check-target-7jvtw" (UID: "e48af8d5-50a8-4242-9220-daa36c82192b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:49:39.939864 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:39.939826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:39.939864 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:39.939858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:39.940493 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:39.939826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:39.940493 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:39.939961 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jvtw" podUID="e48af8d5-50a8-4242-9220-daa36c82192b" Jun 10 12:49:39.940493 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:39.940057 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:49:39.940493 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:39.940150 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxbfg" podUID="dada88db-0cd9-4016-bb87-f117c43fc853" Jun 10 12:49:40.266817 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.266739 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-84.ec2.internal" event="NodeReady" Jun 10 12:49:40.266988 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.266895 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 12:49:40.333520 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.333486 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvllb"] Jun 10 12:49:40.336410 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.336383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.339576 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.339533 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c8ngv"] Jun 10 12:49:40.339740 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.339709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 12:49:40.342330 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.340569 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 12:49:40.342330 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.341296 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6n4pt\"" Jun 10 12:49:40.344725 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.344706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.350617 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.350599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 12:49:40.350736 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.350643 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-79v6m\"" Jun 10 12:49:40.350736 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.350718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 12:49:40.352741 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.352719 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 12:49:40.352923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.352905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvllb"] Jun 10 12:49:40.360670 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.360651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c8ngv"] Jun 10 12:49:40.438608 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.438572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-config-volume\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.438608 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.438605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.438841 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.438668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvv6b\" (UniqueName: \"kubernetes.io/projected/4856e0b3-42af-4310-ae88-47fd9bb79ea8-kube-api-access-xvv6b\") pod \"ingress-canary-c8ngv\" (UID: \"4856e0b3-42af-4310-ae88-47fd9bb79ea8\") " pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.438841 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.438748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4856e0b3-42af-4310-ae88-47fd9bb79ea8-cert\") pod \"ingress-canary-c8ngv\" (UID: \"4856e0b3-42af-4310-ae88-47fd9bb79ea8\") " pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.438841 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.438801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-tmp-dir\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.438841 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.438839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcw2\" (UniqueName: \"kubernetes.io/projected/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-kube-api-access-nlcw2\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.539982 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.539894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4856e0b3-42af-4310-ae88-47fd9bb79ea8-cert\") pod \"ingress-canary-c8ngv\" (UID: \"4856e0b3-42af-4310-ae88-47fd9bb79ea8\") " pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.539982 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.539950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-tmp-dir\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.539982 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.539967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcw2\" (UniqueName: \"kubernetes.io/projected/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-kube-api-access-nlcw2\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.540250 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.540008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-config-volume\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.540250 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.540025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.540250 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.540055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvv6b\" (UniqueName: \"kubernetes.io/projected/4856e0b3-42af-4310-ae88-47fd9bb79ea8-kube-api-access-xvv6b\") pod \"ingress-canary-c8ngv\" (UID: \"4856e0b3-42af-4310-ae88-47fd9bb79ea8\") " pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.540401 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.540334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-tmp-dir\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.540469 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:40.540342 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:40.540554 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:40.540541 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:49:41.040518356 +0000 UTC m=+35.605500097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:49:40.541200 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.541164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-config-volume\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.544651 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.544520 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4856e0b3-42af-4310-ae88-47fd9bb79ea8-cert\") pod \"ingress-canary-c8ngv\" (UID: \"4856e0b3-42af-4310-ae88-47fd9bb79ea8\") " pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.552994 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.552971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcw2\" (UniqueName: \"kubernetes.io/projected/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-kube-api-access-nlcw2\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:40.553151 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.553132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvv6b\" (UniqueName: \"kubernetes.io/projected/4856e0b3-42af-4310-ae88-47fd9bb79ea8-kube-api-access-xvv6b\") pod \"ingress-canary-c8ngv\" (UID: \"4856e0b3-42af-4310-ae88-47fd9bb79ea8\") " pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:40.658239 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:40.658201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c8ngv" Jun 10 12:49:41.044612 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.044577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:41.045081 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:41.044724 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:41.045081 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:41.044787 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:49:42.044770713 +0000 UTC m=+36.609752441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:49:41.157388 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.157319 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c8ngv"] Jun 10 12:49:41.160867 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:49:41.160845 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4856e0b3_42af_4310_ae88_47fd9bb79ea8.slice/crio-b75c217314935feb34bf56b62d923ac80356c80f42413529fe6b09d060aff6c4 WatchSource:0}: Error finding container b75c217314935feb34bf56b62d923ac80356c80f42413529fe6b09d060aff6c4: Status 404 returned error can't find the container with id b75c217314935feb34bf56b62d923ac80356c80f42413529fe6b09d060aff6c4 Jun 10 12:49:41.940751 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.940712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:49:41.940917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.940770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:49:41.940917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.940732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:49:41.944407 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.944127 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:49:41.944407 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.944152 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:49:41.944407 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.944172 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z79dj\"" Jun 10 12:49:41.944407 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.944186 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:49:41.944407 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.944195 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jmsw2\"" Jun 10 12:49:41.944796 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:41.944560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:49:42.054014 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:42.053986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:42.054472 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:42.054156 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:42.054472 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:42.054242 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:49:44.054221964 +0000 UTC m=+38.619203698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:49:42.155937 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:42.155900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c8ngv" event={"ID":"4856e0b3-42af-4310-ae88-47fd9bb79ea8","Type":"ContainerStarted","Data":"b75c217314935feb34bf56b62d923ac80356c80f42413529fe6b09d060aff6c4"} Jun 10 12:49:42.161419 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:42.161392 2576 generic.go:356] "Generic (PLEG): container finished" podID="7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf" containerID="33cbc24de0aef0e488ac4595cd2d232ba15e05e7260baadaf04258cfc71dbca5" exitCode=0 Jun 10 12:49:42.161419 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:42.161430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerDied","Data":"33cbc24de0aef0e488ac4595cd2d232ba15e05e7260baadaf04258cfc71dbca5"} Jun 10 12:49:43.165333 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:43.165148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c8ngv" event={"ID":"4856e0b3-42af-4310-ae88-47fd9bb79ea8","Type":"ContainerStarted","Data":"1c71bb8cef2270f933b59e6b9ef5a419592316128b499085d5d6883f1dbe9921"} Jun 10 12:49:43.168053 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:43.168028 2576 generic.go:356] "Generic (PLEG): container finished" podID="7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf" containerID="b2f83e10f929246fccddcf5e451f2adca5aaa4f2aa7eefa337eeaeb32f77a749" exitCode=0 Jun 10 12:49:43.168166 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:43.168059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerDied","Data":"b2f83e10f929246fccddcf5e451f2adca5aaa4f2aa7eefa337eeaeb32f77a749"} Jun 10 12:49:43.181877 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:43.181833 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c8ngv" podStartSLOduration=1.470616242 podStartE2EDuration="3.181816882s" totalImagesPullingTime="1.71120064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:43.181507947 +0000 UTC m=+37.746489698" watchObservedRunningTime="2026-06-10 12:49:43.181816882 +0000 UTC m=+37.746798632" Jun 10 12:49:44.069269 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:44.069229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:44.069418 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:44.069388 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:44.069466 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:44.069454 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:49:48.06943621 +0000 UTC m=+42.634417939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:49:44.175665 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:44.175582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27x5b" event={"ID":"7cbfc670-cfc7-4da1-95d0-5cd37c23f4bf","Type":"ContainerStarted","Data":"603d08737c3d47d61c8dcaa8811d8e70de27b78653fba2c989226f54c21e8497"} Jun 10 12:49:44.202578 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:44.202533 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-27x5b" podStartSLOduration=8.278942301 podStartE2EDuration="38.202518653s" totalImagesPullingTime="29.923576352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:44.201523381 +0000 UTC m=+38.766505132" watchObservedRunningTime="2026-06-10 12:49:44.202518653 +0000 UTC m=+38.767500433" Jun 10 12:49:48.096770 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:48.096728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:48.097256 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:48.096879 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:48.097256 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:48.096951 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:49:56.096933521 +0000 UTC m=+50.661915266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:49:56.153299 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:49:56.153265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:49:56.153755 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:56.153430 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:56.153755 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:49:56.153496 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:50:12.153477423 +0000 UTC m=+66.718459171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:50:06.156425 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:06.156399 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdt6r" Jun 10 12:50:10.760088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.760045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:50:10.760088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.760093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:50:10.762611 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.762590 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:50:10.762671 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.762653 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:50:10.770760 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:50:10.770733 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:50:10.770876 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:50:10.770802 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:51:14.770784859 +0000 UTC m=+129.335766589 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : secret "metrics-daemon-secret" not found Jun 10 12:50:10.774091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.774071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dada88db-0cd9-4016-bb87-f117c43fc853-original-pull-secret\") pod \"global-pull-secret-syncer-rxbfg\" (UID: \"dada88db-0cd9-4016-bb87-f117c43fc853\") " pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:50:10.777707 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.777688 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb"] Jun 10 12:50:10.780779 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.780763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.783036 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.783015 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 12:50:10.783128 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.783055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 12:50:10.784785 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.784765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 12:50:10.784886 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.784766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xnqbr\"" Jun 10 12:50:10.784886 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.784836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 12:50:10.785734 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.785717 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs"] Jun 10 12:50:10.788041 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.788025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.790158 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.790143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 12:50:10.790421 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.790404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 12:50:10.790633 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.790618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 12:50:10.790790 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.790764 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb"] Jun 10 12:50:10.790953 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.790938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 12:50:10.800413 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.800380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs"] Jun 10 12:50:10.861422 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.861422 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ln6f\" (UniqueName: \"kubernetes.io/projected/e28d592e-1ded-4df2-91e7-58aed980aee2-kube-api-access-9ln6f\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.861618 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.861618 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-ca\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.861618 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shrxf\" (UniqueName: \"kubernetes.io/projected/35d1565e-c1a6-4148-8561-b825a6acb89c-kube-api-access-shrxf\") pod \"managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb\" (UID: \"35d1565e-c1a6-4148-8561-b825a6acb89c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.861715 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35d1565e-c1a6-4148-8561-b825a6acb89c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb\" (UID: \"35d1565e-c1a6-4148-8561-b825a6acb89c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.861715 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:50:10.861715 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-hub\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.861821 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.861742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28d592e-1ded-4df2-91e7-58aed980aee2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.864249 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.864233 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:50:10.874663 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.874638 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:50:10.885258 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.885231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmlw\" (UniqueName: \"kubernetes.io/projected/e48af8d5-50a8-4242-9220-daa36c82192b-kube-api-access-6bmlw\") pod \"network-check-target-7jvtw\" (UID: \"e48af8d5-50a8-4242-9220-daa36c82192b\") " pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:50:10.962819 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-ca\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.962819 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shrxf\" (UniqueName: \"kubernetes.io/projected/35d1565e-c1a6-4148-8561-b825a6acb89c-kube-api-access-shrxf\") pod \"managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb\" (UID: \"35d1565e-c1a6-4148-8561-b825a6acb89c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.963055 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35d1565e-c1a6-4148-8561-b825a6acb89c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb\" (UID: \"35d1565e-c1a6-4148-8561-b825a6acb89c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.963055 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-hub\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.963055 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28d592e-1ded-4df2-91e7-58aed980aee2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.963055 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.963055 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.962969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ln6f\" (UniqueName: \"kubernetes.io/projected/e28d592e-1ded-4df2-91e7-58aed980aee2-kube-api-access-9ln6f\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.963055 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.963001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.963726 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.963697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28d592e-1ded-4df2-91e7-58aed980aee2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.965499 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.965473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-hub\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.965780 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.965755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35d1565e-c1a6-4148-8561-b825a6acb89c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb\" (UID: \"35d1565e-c1a6-4148-8561-b825a6acb89c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.965827 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.965779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.965827 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.965777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-ca\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.966049 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.966036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e28d592e-1ded-4df2-91e7-58aed980aee2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:10.972241 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.972217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shrxf\" (UniqueName: \"kubernetes.io/projected/35d1565e-c1a6-4148-8561-b825a6acb89c-kube-api-access-shrxf\") pod \"managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb\" (UID: \"35d1565e-c1a6-4148-8561-b825a6acb89c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:10.972358 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:10.972239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ln6f\" (UniqueName: \"kubernetes.io/projected/e28d592e-1ded-4df2-91e7-58aed980aee2-kube-api-access-9ln6f\") pod \"cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs\" (UID: \"e28d592e-1ded-4df2-91e7-58aed980aee2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:11.062742 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.062720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z79dj\"" Jun 10 12:50:11.065930 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.065914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxbfg" Jun 10 12:50:11.070914 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.070895 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:50:11.101324 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.101286 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" Jun 10 12:50:11.108388 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.108340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:50:11.231504 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.231474 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxbfg"] Jun 10 12:50:11.234991 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:50:11.234955 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddada88db_0cd9_4016_bb87_f117c43fc853.slice/crio-8d70c6615be38e4dca4bac27dfe21e00f4b280bb25c86817d343b2d8ee24e8c7 WatchSource:0}: Error finding container 8d70c6615be38e4dca4bac27dfe21e00f4b280bb25c86817d343b2d8ee24e8c7: Status 404 returned error can't find the container with id 8d70c6615be38e4dca4bac27dfe21e00f4b280bb25c86817d343b2d8ee24e8c7 Jun 10 12:50:11.270229 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.269663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jvtw"] Jun 10 12:50:11.272848 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:50:11.272811 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48af8d5_50a8_4242_9220_daa36c82192b.slice/crio-f5a233240dcd00c9bb9b63ed248d75f5eb996346b0833952ecf2a4e7008ab8c8 WatchSource:0}: Error finding container f5a233240dcd00c9bb9b63ed248d75f5eb996346b0833952ecf2a4e7008ab8c8: Status 404 returned error can't find the container with id f5a233240dcd00c9bb9b63ed248d75f5eb996346b0833952ecf2a4e7008ab8c8 Jun 10 12:50:11.294965 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.294938 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs"] Jun 10 12:50:11.297947 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:50:11.297920 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode28d592e_1ded_4df2_91e7_58aed980aee2.slice/crio-a461a1a84a26b4503223f5bf2668eb0ccf9e14afabbb0869d83b7e3d7ab9f47b WatchSource:0}: Error finding container a461a1a84a26b4503223f5bf2668eb0ccf9e14afabbb0869d83b7e3d7ab9f47b: Status 404 returned error can't find the container with id a461a1a84a26b4503223f5bf2668eb0ccf9e14afabbb0869d83b7e3d7ab9f47b Jun 10 12:50:11.307223 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:11.307198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb"] Jun 10 12:50:11.310115 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:50:11.310093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35d1565e_c1a6_4148_8561_b825a6acb89c.slice/crio-f08a8cbeac5d6a839d5cde8ac8ad094aea9651c8d383ace3df9e9e6bb892f8a0 WatchSource:0}: Error finding container f08a8cbeac5d6a839d5cde8ac8ad094aea9651c8d383ace3df9e9e6bb892f8a0: Status 404 returned error can't find the container with id f08a8cbeac5d6a839d5cde8ac8ad094aea9651c8d383ace3df9e9e6bb892f8a0 Jun 10 12:50:12.171950 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:12.171870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:50:12.172374 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:50:12.172028 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:50:12.172374 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:50:12.172102 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:50:44.172081497 +0000 UTC m=+98.737063247 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:50:12.240868 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:12.240808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" event={"ID":"e28d592e-1ded-4df2-91e7-58aed980aee2","Type":"ContainerStarted","Data":"a461a1a84a26b4503223f5bf2668eb0ccf9e14afabbb0869d83b7e3d7ab9f47b"} Jun 10 12:50:12.242650 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:12.242615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jvtw" event={"ID":"e48af8d5-50a8-4242-9220-daa36c82192b","Type":"ContainerStarted","Data":"f5a233240dcd00c9bb9b63ed248d75f5eb996346b0833952ecf2a4e7008ab8c8"} Jun 10 12:50:12.244032 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:12.244009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxbfg" event={"ID":"dada88db-0cd9-4016-bb87-f117c43fc853","Type":"ContainerStarted","Data":"8d70c6615be38e4dca4bac27dfe21e00f4b280bb25c86817d343b2d8ee24e8c7"} Jun 10 12:50:12.245306 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:12.245274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" event={"ID":"35d1565e-c1a6-4148-8561-b825a6acb89c","Type":"ContainerStarted","Data":"f08a8cbeac5d6a839d5cde8ac8ad094aea9651c8d383ace3df9e9e6bb892f8a0"} Jun 10 12:50:19.270231 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.270132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" event={"ID":"35d1565e-c1a6-4148-8561-b825a6acb89c","Type":"ContainerStarted","Data":"141a77883bfe3bc892b80ba6a3b3abfb807f1d7ffc34e7c5b3b1845d5aa3a5c2"} Jun 10 12:50:19.272219 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.272191 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" event={"ID":"e28d592e-1ded-4df2-91e7-58aed980aee2","Type":"ContainerStarted","Data":"adeb18c111dfd9ed611d5160b24f9321155f6667939426ce04717f30a5fd973d"} Jun 10 12:50:19.272358 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.272226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" event={"ID":"e28d592e-1ded-4df2-91e7-58aed980aee2","Type":"ContainerStarted","Data":"cbb5061438fffa78a8fb4510460555dc413c5398901532115f47a1ce46587249"} Jun 10 12:50:19.272358 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.272238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" event={"ID":"e28d592e-1ded-4df2-91e7-58aed980aee2","Type":"ContainerStarted","Data":"90a24ae039d832aeb87e0e5f0ca521b97aca952187c20cc249986255280d9cde"} Jun 10 12:50:19.273557 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.273535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jvtw" event={"ID":"e48af8d5-50a8-4242-9220-daa36c82192b","Type":"ContainerStarted","Data":"c515cc308a26cecb3b4ff70b028af44b6fa7bac239112083537805ca86cc5e44"} Jun 10 12:50:19.273660 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.273583 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:50:19.274923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.274905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxbfg" event={"ID":"dada88db-0cd9-4016-bb87-f117c43fc853","Type":"ContainerStarted","Data":"1960c517dfad69d27fb2e0228c033a80b56177c43332c95726b19b617af47ffd"} Jun 10 12:50:19.290681 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.290645 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" podStartSLOduration=1.703461938 podStartE2EDuration="9.290632364s" totalImagesPullingTime="7.587170426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:50:19.289738576 +0000 UTC m=+73.854720326" watchObservedRunningTime="2026-06-10 12:50:19.290632364 +0000 UTC m=+73.855614114" Jun 10 12:50:19.307903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.307864 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rxbfg" podStartSLOduration=65.654995543 podStartE2EDuration="1m13.307847475s" totalImagesPullingTime="7.652851932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:50:19.307723658 +0000 UTC m=+73.872705407" watchObservedRunningTime="2026-06-10 12:50:19.307847475 +0000 UTC m=+73.872829227" Jun 10 12:50:19.329419 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.329378 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" podStartSLOduration=1.740073293 podStartE2EDuration="9.329364529s" totalImagesPullingTime="7.589291236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:50:19.327771703 +0000 UTC m=+73.892753450" watchObservedRunningTime="2026-06-10 12:50:19.329364529 +0000 UTC m=+73.894346271" Jun 10 12:50:19.346502 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:19.346464 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7jvtw" podStartSLOduration=65.763645657 podStartE2EDuration="1m13.346451513s" totalImagesPullingTime="7.582805856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:50:19.345498383 +0000 UTC m=+73.910480133" watchObservedRunningTime="2026-06-10 12:50:19.346451513 +0000 UTC m=+73.911433275" Jun 10 12:50:44.191338 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:44.191244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:50:44.191755 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:50:44.191406 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:50:44.191755 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:50:44.191474 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:51:48.191456927 +0000 UTC m=+162.756438655 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:50:50.279868 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:50:50.279835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7jvtw" Jun 10 12:51:14.808100 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:51:14.808061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:51:14.808622 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:51:14.808179 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:51:14.808622 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:51:14.808238 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:53:16.808224183 +0000 UTC m=+251.373205910 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : secret "metrics-daemon-secret" not found Jun 10 12:51:43.353099 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:51:43.353061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvllb" podUID="c70fcc1a-30b6-45e5-acd5-ef05efbddc7a" Jun 10 12:51:43.505747 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:51:43.505719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvllb" Jun 10 12:51:44.953291 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:51:44.953246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:51:48.245430 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:51:48.245374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:51:48.245847 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:51:48.245537 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:51:48.245847 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:51:48.245631 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls podName:c70fcc1a-30b6-45e5-acd5-ef05efbddc7a nodeName:}" failed. No retries permitted until 2026-06-10 12:53:50.245613666 +0000 UTC m=+284.810595395 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls") pod "dns-default-gvllb" (UID: "c70fcc1a-30b6-45e5-acd5-ef05efbddc7a") : secret "dns-default-metrics-tls" not found Jun 10 12:51:59.940451 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:51:59.940343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:52:19.607158 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:52:19.607124 2576 generic.go:356] "Generic (PLEG): container finished" podID="35d1565e-c1a6-4148-8561-b825a6acb89c" containerID="141a77883bfe3bc892b80ba6a3b3abfb807f1d7ffc34e7c5b3b1845d5aa3a5c2" exitCode=255 Jun 10 12:52:19.607597 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:52:19.607186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" event={"ID":"35d1565e-c1a6-4148-8561-b825a6acb89c","Type":"ContainerDied","Data":"141a77883bfe3bc892b80ba6a3b3abfb807f1d7ffc34e7c5b3b1845d5aa3a5c2"} Jun 10 12:52:19.607597 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:52:19.607482 2576 scope.go:117] "RemoveContainer" containerID="141a77883bfe3bc892b80ba6a3b3abfb807f1d7ffc34e7c5b3b1845d5aa3a5c2" Jun 10 12:52:20.611072 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:52:20.611033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d87f8d98d-rzcnb" event={"ID":"35d1565e-c1a6-4148-8561-b825a6acb89c","Type":"ContainerStarted","Data":"16d9825b79501c454bd85cf3e9a8efdc30bc6f93c0d6397cb2c64361c0f25047"} Jun 10 12:53:16.860408 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:16.860329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:53:16.860920 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:53:16.860479 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:53:16.860920 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:53:16.860555 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs podName:d33b3e9f-5958-4bfd-b01b-bc1c17260dcc nodeName:}" failed. No retries permitted until 2026-06-10 12:55:18.860538677 +0000 UTC m=+373.425520409 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs") pod "network-metrics-daemon-f57dv" (UID: "d33b3e9f-5958-4bfd-b01b-bc1c17260dcc") : secret "metrics-daemon-secret" not found Jun 10 12:53:37.195663 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:37.195581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gfff_3604a740-60af-4080-b48a-d4b2e564bea2/dns-node-resolver/0.log" Jun 10 12:53:38.197362 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:38.197331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2l9wh_68a65828-4c10-4af2-9ce8-f8a1549c6ace/node-ca/0.log" Jun 10 12:53:39.195852 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:39.195824 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c8ngv_4856e0b3-42af-4310-ae88-47fd9bb79ea8/serve-healthcheck-canary/0.log" Jun 10 12:53:46.506159 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:53:46.506119 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvllb" podUID="c70fcc1a-30b6-45e5-acd5-ef05efbddc7a" Jun 10 12:53:46.844870 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:46.844841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvllb" Jun 10 12:53:50.290121 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:50.290081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:53:50.292310 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:50.292289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70fcc1a-30b6-45e5-acd5-ef05efbddc7a-metrics-tls\") pod \"dns-default-gvllb\" (UID: \"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a\") " pod="openshift-dns/dns-default-gvllb" Jun 10 12:53:50.448414 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:50.448382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6n4pt\"" Jun 10 12:53:50.456436 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:50.456415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvllb" Jun 10 12:53:50.583433 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:50.583403 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvllb"] Jun 10 12:53:50.586667 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:53:50.586638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70fcc1a_30b6_45e5_acd5_ef05efbddc7a.slice/crio-9ff14243e06f2d3543d84deddda25dc4ad97707792320e9d00125921bd35706b WatchSource:0}: Error finding container 9ff14243e06f2d3543d84deddda25dc4ad97707792320e9d00125921bd35706b: Status 404 returned error can't find the container with id 9ff14243e06f2d3543d84deddda25dc4ad97707792320e9d00125921bd35706b Jun 10 12:53:50.857124 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:50.857041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvllb" event={"ID":"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a","Type":"ContainerStarted","Data":"9ff14243e06f2d3543d84deddda25dc4ad97707792320e9d00125921bd35706b"} Jun 10 12:53:52.865487 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:52.865446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvllb" event={"ID":"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a","Type":"ContainerStarted","Data":"44af8bf33cacd226a994d0f8813c15f52384fc309c31991722de6d1f152d8cea"} Jun 10 12:53:52.865862 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:52.865513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvllb" event={"ID":"c70fcc1a-30b6-45e5-acd5-ef05efbddc7a","Type":"ContainerStarted","Data":"1a717aaff2b0ce1015d8baedb8fbf83e9eb00653ab1fb560ed755dd00bdedbe9"} Jun 10 12:53:52.865862 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:52.865593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvllb" Jun 10 12:53:52.887085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:52.887026 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvllb" podStartSLOduration=251.456662321 podStartE2EDuration="4m12.887010518s" totalImagesPullingTime="1.430348197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:53:52.886629991 +0000 UTC m=+287.451611742" watchObservedRunningTime="2026-06-10 12:53:52.887010518 +0000 UTC m=+287.451992268" Jun 10 12:53:58.197850 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.197812 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lgtr5"] Jun 10 12:53:58.202624 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.202595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.207474 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.207382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 12:53:58.207474 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.207450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 12:53:58.207671 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.207483 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 12:53:58.207671 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.207383 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 12:53:58.207671 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.207383 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7zsvb\"" Jun 10 12:53:58.214387 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.214367 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lgtr5"] Jun 10 12:53:58.284016 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.283987 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h"] Jun 10 12:53:58.286073 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.286056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:58.289015 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.288996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 12:53:58.289111 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.289045 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sk7b5\"" Jun 10 12:53:58.297142 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.297121 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-t94dv"] Jun 10 12:53:58.299195 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.299180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:53:58.302646 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.302625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 12:53:58.302753 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.302701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 12:53:58.302813 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.302768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sn2lc\"" Jun 10 12:53:58.303979 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.303958 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h"] Jun 10 12:53:58.321266 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.321246 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-t94dv"] Jun 10 12:53:58.343892 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.343862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.343892 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.343892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-crio-socket\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.344061 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.343908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sv2s\" (UniqueName: \"kubernetes.io/projected/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-kube-api-access-2sv2s\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.344061 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.343958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-data-volume\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.344061 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.344000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.444690 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28f08889-8be1-41b7-a935-cc8108d04bde-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fsz5h\" (UID: \"28f08889-8be1-41b7-a935-cc8108d04bde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:58.444882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.444882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.444882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-crio-socket\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.444882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sv2s\" (UniqueName: \"kubernetes.io/projected/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-kube-api-access-2sv2s\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.444882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-data-volume\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.444882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsr9c\" (UniqueName: \"kubernetes.io/projected/e0467961-bfa3-48ed-9cfb-8ae8982270c3-kube-api-access-xsr9c\") pod \"downloads-6657875f97-t94dv\" (UID: \"e0467961-bfa3-48ed-9cfb-8ae8982270c3\") " pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:53:58.445115 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.444882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-crio-socket\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.445254 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.445232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-data-volume\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.445491 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.445475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.447114 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.447094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.454683 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.454627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sv2s\" (UniqueName: \"kubernetes.io/projected/c73a55a6-c1e3-40b1-90f8-451c4925cc3d-kube-api-access-2sv2s\") pod \"insights-runtime-extractor-lgtr5\" (UID: \"c73a55a6-c1e3-40b1-90f8-451c4925cc3d\") " pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.510945 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.510910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lgtr5" Jun 10 12:53:58.546279 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.546235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsr9c\" (UniqueName: \"kubernetes.io/projected/e0467961-bfa3-48ed-9cfb-8ae8982270c3-kube-api-access-xsr9c\") pod \"downloads-6657875f97-t94dv\" (UID: \"e0467961-bfa3-48ed-9cfb-8ae8982270c3\") " pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:53:58.546494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.546299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28f08889-8be1-41b7-a935-cc8108d04bde-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fsz5h\" (UID: \"28f08889-8be1-41b7-a935-cc8108d04bde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:58.549101 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.549075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28f08889-8be1-41b7-a935-cc8108d04bde-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fsz5h\" (UID: \"28f08889-8be1-41b7-a935-cc8108d04bde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:58.560800 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.560774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsr9c\" (UniqueName: \"kubernetes.io/projected/e0467961-bfa3-48ed-9cfb-8ae8982270c3-kube-api-access-xsr9c\") pod \"downloads-6657875f97-t94dv\" (UID: \"e0467961-bfa3-48ed-9cfb-8ae8982270c3\") " pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:53:58.594384 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.594356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:58.608683 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.608644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:53:58.651366 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.651327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lgtr5"] Jun 10 12:53:58.655486 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:53:58.655453 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73a55a6_c1e3_40b1_90f8_451c4925cc3d.slice/crio-56df300f124714f262336cf8b7df14c76f6b52d2c9646e943bf69987ef78fbc0 WatchSource:0}: Error finding container 56df300f124714f262336cf8b7df14c76f6b52d2c9646e943bf69987ef78fbc0: Status 404 returned error can't find the container with id 56df300f124714f262336cf8b7df14c76f6b52d2c9646e943bf69987ef78fbc0 Jun 10 12:53:58.741843 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.741803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h"] Jun 10 12:53:58.745099 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:53:58.744776 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f08889_8be1_41b7_a935_cc8108d04bde.slice/crio-67ccc460cabb2cfa505645e84f45eb7bcf7a0820d5c03a9318a3befa42ca930d WatchSource:0}: Error finding container 67ccc460cabb2cfa505645e84f45eb7bcf7a0820d5c03a9318a3befa42ca930d: Status 404 returned error can't find the container with id 67ccc460cabb2cfa505645e84f45eb7bcf7a0820d5c03a9318a3befa42ca930d Jun 10 12:53:58.755046 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.755024 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-t94dv"] Jun 10 12:53:58.757896 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:53:58.757860 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0467961_bfa3_48ed_9cfb_8ae8982270c3.slice/crio-89804a04e63f3bdf94fd148666e91613fd822c6fb7cdfa11dca05b7e2c93a239 WatchSource:0}: Error finding container 89804a04e63f3bdf94fd148666e91613fd822c6fb7cdfa11dca05b7e2c93a239: Status 404 returned error can't find the container with id 89804a04e63f3bdf94fd148666e91613fd822c6fb7cdfa11dca05b7e2c93a239 Jun 10 12:53:58.884431 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.884393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-t94dv" event={"ID":"e0467961-bfa3-48ed-9cfb-8ae8982270c3","Type":"ContainerStarted","Data":"89804a04e63f3bdf94fd148666e91613fd822c6fb7cdfa11dca05b7e2c93a239"} Jun 10 12:53:58.885459 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.885433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" event={"ID":"28f08889-8be1-41b7-a935-cc8108d04bde","Type":"ContainerStarted","Data":"67ccc460cabb2cfa505645e84f45eb7bcf7a0820d5c03a9318a3befa42ca930d"} Jun 10 12:53:58.886825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.886798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgtr5" event={"ID":"c73a55a6-c1e3-40b1-90f8-451c4925cc3d","Type":"ContainerStarted","Data":"7456a730c3080345879bd46686c4b82e2fd02be5729908702a5b201c5927960c"} Jun 10 12:53:58.886934 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:58.886848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgtr5" event={"ID":"c73a55a6-c1e3-40b1-90f8-451c4925cc3d","Type":"ContainerStarted","Data":"56df300f124714f262336cf8b7df14c76f6b52d2c9646e943bf69987ef78fbc0"} Jun 10 12:53:59.892837 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:59.892759 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" event={"ID":"28f08889-8be1-41b7-a935-cc8108d04bde","Type":"ContainerStarted","Data":"1e05f13715eb0488a9a0882997b6c544ee9ec8f720218497e508f326d72b7026"} Jun 10 12:53:59.893271 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:59.893073 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:59.895404 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:59.895376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgtr5" event={"ID":"c73a55a6-c1e3-40b1-90f8-451c4925cc3d","Type":"ContainerStarted","Data":"78b7fbfdd3b52b799b95b67003dfac53c2dd43041a29bb72f4bd2c66767b1734"} Jun 10 12:53:59.898969 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:59.898896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" Jun 10 12:53:59.910399 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:53:59.910334 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fsz5h" podStartSLOduration=0.869302146 podStartE2EDuration="1.91031427s" totalImagesPullingTime="1.041012124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:53:59.908837655 +0000 UTC m=+294.473819406" watchObservedRunningTime="2026-06-10 12:53:59.91031427 +0000 UTC m=+294.475296023" Jun 10 12:54:01.904593 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:01.904553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lgtr5" event={"ID":"c73a55a6-c1e3-40b1-90f8-451c4925cc3d","Type":"ContainerStarted","Data":"d3c1a34c40c8f616d207e80ede9dd1a3a25260d188cbf6827306b620bc40cac5"} Jun 10 12:54:02.870420 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:02.870388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvllb" Jun 10 12:54:02.896989 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:02.896924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lgtr5" podStartSLOduration=2.654400067 podStartE2EDuration="4.896904063s" totalImagesPullingTime="2.242503996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:53:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:01.927389727 +0000 UTC m=+296.492371476" watchObservedRunningTime="2026-06-10 12:54:02.896904063 +0000 UTC m=+297.461885813" Jun 10 12:54:02.940804 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:54:02.940761 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f57dv" podUID="d33b3e9f-5958-4bfd-b01b-bc1c17260dcc" Jun 10 12:54:05.349390 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.349342 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7"] Jun 10 12:54:05.352242 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.352220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.355548 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.355427 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 12:54:05.355696 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.355676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 12:54:05.355773 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.355714 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 12:54:05.356230 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.356199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 12:54:05.357139 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.357123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 12:54:05.357221 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.357187 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jlhj7\"" Jun 10 12:54:05.359054 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.359034 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 12:54:05.369952 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.369926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7"] Jun 10 12:54:05.371083 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.371056 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cwvk6"] Jun 10 12:54:05.374388 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.374367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.377210 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.377174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 12:54:05.377313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.377263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-675mt\"" Jun 10 12:54:05.377313 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.377264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 12:54:05.378476 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.378455 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 12:54:05.402416 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.402416 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.402636 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h76h\" (UniqueName: \"kubernetes.io/projected/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-api-access-9h76h\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.402636 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bf8a9ca-54a9-466d-b9b3-090456f071e8-metrics-client-ca\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.402636 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-tls\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.402636 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.402636 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.402889 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-sys\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.402889 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcdd764c-d9ea-4d67-b002-a795b034b2f3-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.402889 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpfv\" (UniqueName: \"kubernetes.io/projected/5bf8a9ca-54a9-466d-b9b3-090456f071e8-kube-api-access-zgpfv\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.402889 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fcdd764c-d9ea-4d67-b002-a795b034b2f3-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.403091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-root\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.403091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-textfile\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.403091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.402956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.403091 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.403001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-wtmp\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.503430 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-root\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.503430 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-textfile\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503500 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-root\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-wtmp\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h76h\" (UniqueName: \"kubernetes.io/projected/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-api-access-9h76h\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bf8a9ca-54a9-466d-b9b3-090456f071e8-metrics-client-ca\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.503680 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-tls\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-wtmp\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-sys\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcdd764c-d9ea-4d67-b002-a795b034b2f3-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-textfile\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgpfv\" (UniqueName: \"kubernetes.io/projected/5bf8a9ca-54a9-466d-b9b3-090456f071e8-kube-api-access-zgpfv\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.503931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fcdd764c-d9ea-4d67-b002-a795b034b2f3-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.504068 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.504054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bf8a9ca-54a9-466d-b9b3-090456f071e8-sys\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504533 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.504258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fcdd764c-d9ea-4d67-b002-a795b034b2f3-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.504642 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.504597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.504789 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.504754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bf8a9ca-54a9-466d-b9b3-090456f071e8-metrics-client-ca\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504919 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.504899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.504990 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.504923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcdd764c-d9ea-4d67-b002-a795b034b2f3-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.506751 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.506727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.507180 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.507157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bf8a9ca-54a9-466d-b9b3-090456f071e8-node-exporter-tls\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.507276 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.507217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.507331 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.507278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.516399 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.516332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h76h\" (UniqueName: \"kubernetes.io/projected/fcdd764c-d9ea-4d67-b002-a795b034b2f3-kube-api-access-9h76h\") pod \"kube-state-metrics-57bbf8bfb5-hb4c7\" (UID: \"fcdd764c-d9ea-4d67-b002-a795b034b2f3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.517528 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.517498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgpfv\" (UniqueName: \"kubernetes.io/projected/5bf8a9ca-54a9-466d-b9b3-090456f071e8-kube-api-access-zgpfv\") pod \"node-exporter-cwvk6\" (UID: \"5bf8a9ca-54a9-466d-b9b3-090456f071e8\") " pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.663787 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.663691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" Jun 10 12:54:05.685133 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.685101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwvk6" Jun 10 12:54:05.698980 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:54:05.698928 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf8a9ca_54a9_466d_b9b3_090456f071e8.slice/crio-85be87a9e940aafd2bb4fb124d18ceb4509d0533d3bc4b1050243b0b3cc55882 WatchSource:0}: Error finding container 85be87a9e940aafd2bb4fb124d18ceb4509d0533d3bc4b1050243b0b3cc55882: Status 404 returned error can't find the container with id 85be87a9e940aafd2bb4fb124d18ceb4509d0533d3bc4b1050243b0b3cc55882 Jun 10 12:54:05.820582 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.820548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7"] Jun 10 12:54:05.824031 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:54:05.823999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdd764c_d9ea_4d67_b002_a795b034b2f3.slice/crio-96437a4993a6349491d4ac4008e78d3eb99bf4a14244265e36b0aa890374597f WatchSource:0}: Error finding container 96437a4993a6349491d4ac4008e78d3eb99bf4a14244265e36b0aa890374597f: Status 404 returned error can't find the container with id 96437a4993a6349491d4ac4008e78d3eb99bf4a14244265e36b0aa890374597f Jun 10 12:54:05.879525 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.875971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:54:05.883499 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.883473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:54:05.888774 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.888751 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:54:05.919089 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.919004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwvk6" event={"ID":"5bf8a9ca-54a9-466d-b9b3-090456f071e8","Type":"ContainerStarted","Data":"85be87a9e940aafd2bb4fb124d18ceb4509d0533d3bc4b1050243b0b3cc55882"} Jun 10 12:54:05.920244 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:05.920212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" event={"ID":"fcdd764c-d9ea-4d67-b002-a795b034b2f3","Type":"ContainerStarted","Data":"96437a4993a6349491d4ac4008e78d3eb99bf4a14244265e36b0aa890374597f"} Jun 10 12:54:06.926497 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:06.926403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwvk6" event={"ID":"5bf8a9ca-54a9-466d-b9b3-090456f071e8","Type":"ContainerStarted","Data":"736ab48ddb0b308782102dda631148093da3c8ef1e8b12f135d15a17a40664e0"} Jun 10 12:54:07.478489 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.478398 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-845dffccc-lxwv8"] Jun 10 12:54:07.481924 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.481894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.485918 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.485776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 12:54:07.486066 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.485927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 12:54:07.486066 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.485934 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 12:54:07.486333 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.486310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2hfo0i75pbo00\"" Jun 10 12:54:07.486505 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.486464 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wq49v\"" Jun 10 12:54:07.486713 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.486629 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 12:54:07.486713 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.486699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 12:54:07.500290 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.499992 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-845dffccc-lxwv8"] Jun 10 12:54:07.520339 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-tls\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520518 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520518 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520623 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-grpc-tls\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520623 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wf9c\" (UniqueName: \"kubernetes.io/projected/e144e0ab-47f8-47d9-bc28-f28219fbf388-kube-api-access-6wf9c\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520623 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e144e0ab-47f8-47d9-bc28-f28219fbf388-metrics-client-ca\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.520825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.520723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621709 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e144e0ab-47f8-47d9-bc28-f28219fbf388-metrics-client-ca\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-tls\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.621903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-grpc-tls\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.622230 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.621917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wf9c\" (UniqueName: \"kubernetes.io/projected/e144e0ab-47f8-47d9-bc28-f28219fbf388-kube-api-access-6wf9c\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.622593 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.622565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e144e0ab-47f8-47d9-bc28-f28219fbf388-metrics-client-ca\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.625217 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.625166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.625661 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.625615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.625818 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.625784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-tls\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.626301 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.626276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-grpc-tls\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.626570 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.626528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.627586 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.627564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e144e0ab-47f8-47d9-bc28-f28219fbf388-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.631817 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.631798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wf9c\" (UniqueName: \"kubernetes.io/projected/e144e0ab-47f8-47d9-bc28-f28219fbf388-kube-api-access-6wf9c\") pod \"thanos-querier-845dffccc-lxwv8\" (UID: \"e144e0ab-47f8-47d9-bc28-f28219fbf388\") " pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.793787 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.793697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:07.931899 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.931865 2576 generic.go:356] "Generic (PLEG): container finished" podID="5bf8a9ca-54a9-466d-b9b3-090456f071e8" containerID="736ab48ddb0b308782102dda631148093da3c8ef1e8b12f135d15a17a40664e0" exitCode=0 Jun 10 12:54:07.932331 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.931957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwvk6" event={"ID":"5bf8a9ca-54a9-466d-b9b3-090456f071e8","Type":"ContainerDied","Data":"736ab48ddb0b308782102dda631148093da3c8ef1e8b12f135d15a17a40664e0"} Jun 10 12:54:07.934294 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.934270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" event={"ID":"fcdd764c-d9ea-4d67-b002-a795b034b2f3","Type":"ContainerStarted","Data":"28b6bf3eb66337f685fd0996ebec9d072139e10c020a66c147bbef13e1fd5db4"} Jun 10 12:54:07.934408 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.934318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" event={"ID":"fcdd764c-d9ea-4d67-b002-a795b034b2f3","Type":"ContainerStarted","Data":"002e2c7bb200de50953863c9cdb4567564f6f798a55b9169693cb2ba9190f3d5"} Jun 10 12:54:07.934408 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.934342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" event={"ID":"fcdd764c-d9ea-4d67-b002-a795b034b2f3","Type":"ContainerStarted","Data":"54551957ba6eabdffdc1fa854135f2ebdd347a1fc2e3b71ce64cf8cf0beddafd"} Jun 10 12:54:07.950808 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:07.950770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-845dffccc-lxwv8"] Jun 10 12:54:10.114220 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.114161 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-hb4c7" podStartSLOduration=3.819122631 podStartE2EDuration="5.114143595s" totalImagesPullingTime="1.295020964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:07.971694594 +0000 UTC m=+302.536676345" watchObservedRunningTime="2026-06-10 12:54:10.114143595 +0000 UTC m=+304.679125323" Jun 10 12:54:10.115563 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.115539 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-765t8"] Jun 10 12:54:10.119134 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.119114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.121308 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.121281 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 12:54:10.121439 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.121374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-m25w5\"" Jun 10 12:54:10.128839 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.128808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-765t8"] Jun 10 12:54:10.142817 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.142783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73ad9444-42d0-4f42-a0e3-59279cdf5d44-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.142817 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.142820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85m4p\" (UniqueName: \"kubernetes.io/projected/73ad9444-42d0-4f42-a0e3-59279cdf5d44-kube-api-access-85m4p\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.243315 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.243277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73ad9444-42d0-4f42-a0e3-59279cdf5d44-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.243315 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.243318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85m4p\" (UniqueName: \"kubernetes.io/projected/73ad9444-42d0-4f42-a0e3-59279cdf5d44-kube-api-access-85m4p\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.243566 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:54:10.243462 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 12:54:10.243625 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:54:10.243581 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73ad9444-42d0-4f42-a0e3-59279cdf5d44-monitoring-plugin-cert podName:73ad9444-42d0-4f42-a0e3-59279cdf5d44 nodeName:}" failed. No retries permitted until 2026-06-10 12:54:10.743561293 +0000 UTC m=+305.308543020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/73ad9444-42d0-4f42-a0e3-59279cdf5d44-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-765t8" (UID: "73ad9444-42d0-4f42-a0e3-59279cdf5d44") : secret "monitoring-plugin-cert" not found Jun 10 12:54:10.253558 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.253533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85m4p\" (UniqueName: \"kubernetes.io/projected/73ad9444-42d0-4f42-a0e3-59279cdf5d44-kube-api-access-85m4p\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.746828 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.746787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73ad9444-42d0-4f42-a0e3-59279cdf5d44-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:10.749573 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:10.749544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73ad9444-42d0-4f42-a0e3-59279cdf5d44-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-765t8\" (UID: \"73ad9444-42d0-4f42-a0e3-59279cdf5d44\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:11.030024 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:11.029929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:14.843431 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:54:14.843397 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode144e0ab_47f8_47d9_bc28_f28219fbf388.slice/crio-d94153e51565e5e4760b9d5031983e2c02d685e24b3d5bdccfd448035932e7fb WatchSource:0}: Error finding container d94153e51565e5e4760b9d5031983e2c02d685e24b3d5bdccfd448035932e7fb: Status 404 returned error can't find the container with id d94153e51565e5e4760b9d5031983e2c02d685e24b3d5bdccfd448035932e7fb Jun 10 12:54:14.845494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:14.845470 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:54:14.962702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:14.962673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"d94153e51565e5e4760b9d5031983e2c02d685e24b3d5bdccfd448035932e7fb"} Jun 10 12:54:14.964637 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:14.964616 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwvk6" event={"ID":"5bf8a9ca-54a9-466d-b9b3-090456f071e8","Type":"ContainerStarted","Data":"c9efc6c79903f99b96c46bcef3db98eb67e343688ce286224ea70d769b90472a"} Jun 10 12:54:14.979541 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:14.979509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-765t8"] Jun 10 12:54:14.982620 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:54:14.982586 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ad9444_42d0_4f42_a0e3_59279cdf5d44.slice/crio-774541a32e4d752b0d3b412864c6278262bad2edb20a7235f14b2c739a970e7d WatchSource:0}: Error finding container 774541a32e4d752b0d3b412864c6278262bad2edb20a7235f14b2c739a970e7d: Status 404 returned error can't find the container with id 774541a32e4d752b0d3b412864c6278262bad2edb20a7235f14b2c739a970e7d Jun 10 12:54:15.973186 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:15.973146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwvk6" event={"ID":"5bf8a9ca-54a9-466d-b9b3-090456f071e8","Type":"ContainerStarted","Data":"1e43a22ece3f23ba86e63baca14216c975e8fd602aff2bc2a42d91fb6bfda4ae"} Jun 10 12:54:15.977666 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:15.977616 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" event={"ID":"73ad9444-42d0-4f42-a0e3-59279cdf5d44","Type":"ContainerStarted","Data":"774541a32e4d752b0d3b412864c6278262bad2edb20a7235f14b2c739a970e7d"} Jun 10 12:54:15.982146 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:15.981607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-t94dv" event={"ID":"e0467961-bfa3-48ed-9cfb-8ae8982270c3","Type":"ContainerStarted","Data":"61a4f1b90acaae55434bc219c30c2c9d1276205d7238ba25b8aed6933803c54e"} Jun 10 12:54:15.982146 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:15.982105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:54:15.995860 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:15.995737 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cwvk6" podStartSLOduration=9.968333303 podStartE2EDuration="10.995716929s" totalImagesPullingTime="946.016844ms" totalInitContainerRuntime="81.366782ms" isStatefulPod=true podCreationTimestamp="2026-06-10 12:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:15.994514611 +0000 UTC m=+310.559496379" watchObservedRunningTime="2026-06-10 12:54:15.995716929 +0000 UTC m=+310.560698681" Jun 10 12:54:15.997930 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:15.997885 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-t94dv" Jun 10 12:54:16.020424 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:16.020341 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-t94dv" podStartSLOduration=1.8369831680000002 podStartE2EDuration="18.020321006s" totalImagesPullingTime="16.183337838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:16.018406081 +0000 UTC m=+310.583387856" watchObservedRunningTime="2026-06-10 12:54:16.020321006 +0000 UTC m=+310.585302759" Jun 10 12:54:17.940458 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:17.940420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:54:17.992516 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:17.992478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"ea40401cd082577d6fa46bbc580d524f39bb13df393dd3fa018747f343a4316b"} Jun 10 12:54:17.994638 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:17.994305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" event={"ID":"73ad9444-42d0-4f42-a0e3-59279cdf5d44","Type":"ContainerStarted","Data":"3d46113bea59c69dddf33c5ef492b7fd423e68bf6ec87fddd776abe320ba08be"} Jun 10 12:54:17.994638 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:17.994396 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:18.000665 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:18.000646 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" Jun 10 12:54:18.030243 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:18.030185 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-765t8" podStartSLOduration=5.302767822 podStartE2EDuration="8.030163349s" totalImagesPullingTime="2.727395527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:18.029120325 +0000 UTC m=+312.594102088" watchObservedRunningTime="2026-06-10 12:54:18.030163349 +0000 UTC m=+312.595145100" Jun 10 12:54:19.003263 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:19.002725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"88d382e2882ee348338de4c5bddc615a5b3a7f3776487cf965a35f63505d2564"} Jun 10 12:54:19.003263 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:19.002814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"2caf1946ba5a6aaf4dda6628423284cd84d453f2711edcf3aa713ebe0f10beb2"} Jun 10 12:54:20.010667 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:20.010631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"3e0a2d837548000aa84de566c92a837b454e660d9e41d9807f6d8a9237208c39"} Jun 10 12:54:20.011194 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:20.010713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"f06909897042b6e6ea4595d36e42247c1634979be314c726545c8740d4582070"} Jun 10 12:54:20.011194 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:20.010759 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" event={"ID":"e144e0ab-47f8-47d9-bc28-f28219fbf388","Type":"ContainerStarted","Data":"2896a069a782ed84799f4a6f4b3bce89537758846f45f1e32750cbc08d9e0691"} Jun 10 12:54:20.044403 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:20.044324 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" podStartSLOduration=8.796099707 podStartE2EDuration="13.044300547s" totalImagesPullingTime="4.24820084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:54:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:20.04302442 +0000 UTC m=+314.608006193" watchObservedRunningTime="2026-06-10 12:54:20.044300547 +0000 UTC m=+314.609282291" Jun 10 12:54:21.014909 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:21.014872 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:21.109771 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:21.109716 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" podUID="e28d592e-1ded-4df2-91e7-58aed980aee2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 12:54:22.025125 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:22.025095 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-845dffccc-lxwv8" Jun 10 12:54:31.110238 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:31.110200 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" podUID="e28d592e-1ded-4df2-91e7-58aed980aee2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 12:54:41.110251 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:41.110211 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" podUID="e28d592e-1ded-4df2-91e7-58aed980aee2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 12:54:41.110643 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:41.110279 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" Jun 10 12:54:41.110772 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:41.110743 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"adeb18c111dfd9ed611d5160b24f9321155f6667939426ce04717f30a5fd973d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 12:54:41.110813 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:41.110794 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" podUID="e28d592e-1ded-4df2-91e7-58aed980aee2" containerName="service-proxy" containerID="cri-o://adeb18c111dfd9ed611d5160b24f9321155f6667939426ce04717f30a5fd973d" gracePeriod=30 Jun 10 12:54:42.091979 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:42.091938 2576 generic.go:356] "Generic (PLEG): container finished" podID="e28d592e-1ded-4df2-91e7-58aed980aee2" containerID="adeb18c111dfd9ed611d5160b24f9321155f6667939426ce04717f30a5fd973d" exitCode=2 Jun 10 12:54:42.092217 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:42.092010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" event={"ID":"e28d592e-1ded-4df2-91e7-58aed980aee2","Type":"ContainerDied","Data":"adeb18c111dfd9ed611d5160b24f9321155f6667939426ce04717f30a5fd973d"} Jun 10 12:54:42.092217 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:42.092052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ccf9b96b9-l4hcs" event={"ID":"e28d592e-1ded-4df2-91e7-58aed980aee2","Type":"ContainerStarted","Data":"e190333bed53d9351dd4b80244887662a67a10e5472dfbd3563c26506899d762"} Jun 10 12:54:46.272119 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:54:46.272088 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c8ngv_4856e0b3-42af-4310-ae88-47fd9bb79ea8/serve-healthcheck-canary/0.log" Jun 10 12:55:18.902085 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:18.901989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:55:18.904247 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:18.904226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33b3e9f-5958-4bfd-b01b-bc1c17260dcc-metrics-certs\") pod \"network-metrics-daemon-f57dv\" (UID: \"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc\") " pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:55:19.144424 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:19.144386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jmsw2\"" Jun 10 12:55:19.151684 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:19.151656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f57dv" Jun 10 12:55:19.287488 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:19.287342 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f57dv"] Jun 10 12:55:19.290151 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:55:19.290123 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33b3e9f_5958_4bfd_b01b_bc1c17260dcc.slice/crio-a4d4125d6f5526429381871f6833863184baee0ce0c5654a965c2eb1bfc4690d WatchSource:0}: Error finding container a4d4125d6f5526429381871f6833863184baee0ce0c5654a965c2eb1bfc4690d: Status 404 returned error can't find the container with id a4d4125d6f5526429381871f6833863184baee0ce0c5654a965c2eb1bfc4690d Jun 10 12:55:20.231669 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:20.231631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f57dv" event={"ID":"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc","Type":"ContainerStarted","Data":"faeca7d4ccc48ee43d5a9ae86d5f58c0fc6f941ec7467ac90ab57c212507499f"} Jun 10 12:55:20.231975 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:20.231698 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f57dv" event={"ID":"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc","Type":"ContainerStarted","Data":"a4d4125d6f5526429381871f6833863184baee0ce0c5654a965c2eb1bfc4690d"} Jun 10 12:55:21.236717 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:21.236676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f57dv" event={"ID":"d33b3e9f-5958-4bfd-b01b-bc1c17260dcc","Type":"ContainerStarted","Data":"c13389833d979e9069ca3109f715a0607f4dd0ff690c8232a5e2094d1727151e"} Jun 10 12:55:21.257720 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:55:21.257669 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f57dv" podStartSLOduration=374.409719995 podStartE2EDuration="6m15.257653588s" totalImagesPullingTime="847.933593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:55:21.257495949 +0000 UTC m=+375.822477715" watchObservedRunningTime="2026-06-10 12:55:21.257653588 +0000 UTC m=+375.822635339" Jun 10 12:57:15.341998 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.341964 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt"] Jun 10 12:57:15.344718 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.344700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.347103 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.347078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:57:15.347103 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.347099 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:57:15.347804 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.347789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-chjxg\"" Jun 10 12:57:15.363706 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.363676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt"] Jun 10 12:57:15.478011 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.477968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5zz\" (UniqueName: \"kubernetes.io/projected/57bfd382-e2a8-4855-b7d5-c8814eb26802-kube-api-access-zf5zz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.478011 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.478016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.478236 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.478047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.579059 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.579018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5zz\" (UniqueName: \"kubernetes.io/projected/57bfd382-e2a8-4855-b7d5-c8814eb26802-kube-api-access-zf5zz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.579059 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.579065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.579270 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.579085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.579452 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.579433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.579496 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.579465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.589029 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.589010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5zz\" (UniqueName: \"kubernetes.io/projected/57bfd382-e2a8-4855-b7d5-c8814eb26802-kube-api-access-zf5zz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.654298 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.654216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:15.781821 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:15.781757 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt"] Jun 10 12:57:15.784656 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:57:15.784629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57bfd382_e2a8_4855_b7d5_c8814eb26802.slice/crio-447fb1207d98da22fed652e32f2b48b7c56266e9ab5f4375c332dede90161c09 WatchSource:0}: Error finding container 447fb1207d98da22fed652e32f2b48b7c56266e9ab5f4375c332dede90161c09: Status 404 returned error can't find the container with id 447fb1207d98da22fed652e32f2b48b7c56266e9ab5f4375c332dede90161c09 Jun 10 12:57:16.642903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:16.642861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" event={"ID":"57bfd382-e2a8-4855-b7d5-c8814eb26802","Type":"ContainerStarted","Data":"447fb1207d98da22fed652e32f2b48b7c56266e9ab5f4375c332dede90161c09"} Jun 10 12:57:21.664024 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:21.663992 2576 generic.go:356] "Generic (PLEG): container finished" podID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerID="65424d68aaddc31378e3772507045622ce2f638705c715d9b293b9f1517dea55" exitCode=0 Jun 10 12:57:21.664455 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:21.664081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" event={"ID":"57bfd382-e2a8-4855-b7d5-c8814eb26802","Type":"ContainerDied","Data":"65424d68aaddc31378e3772507045622ce2f638705c715d9b293b9f1517dea55"} Jun 10 12:57:33.708414 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:33.708298 2576 generic.go:356] "Generic (PLEG): container finished" podID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerID="ecce0716e2dc3eb33d52c9bdf71706a72fa365f71e066d5b3e8c4c06ac2506dd" exitCode=0 Jun 10 12:57:33.708414 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:33.708390 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" event={"ID":"57bfd382-e2a8-4855-b7d5-c8814eb26802","Type":"ContainerDied","Data":"ecce0716e2dc3eb33d52c9bdf71706a72fa365f71e066d5b3e8c4c06ac2506dd"} Jun 10 12:57:40.739622 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:40.739590 2576 generic.go:356] "Generic (PLEG): container finished" podID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerID="2d62b2d53d6ae79a56604350a67eb1dd89c84e2e6c1236b7c2640d6861e81c33" exitCode=0 Jun 10 12:57:40.739997 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:40.739643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" event={"ID":"57bfd382-e2a8-4855-b7d5-c8814eb26802","Type":"ContainerDied","Data":"2d62b2d53d6ae79a56604350a67eb1dd89c84e2e6c1236b7c2640d6861e81c33"} Jun 10 12:57:41.872621 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.872599 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:41.982925 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.982894 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-util\") pod \"57bfd382-e2a8-4855-b7d5-c8814eb26802\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " Jun 10 12:57:41.983077 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.982942 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf5zz\" (UniqueName: \"kubernetes.io/projected/57bfd382-e2a8-4855-b7d5-c8814eb26802-kube-api-access-zf5zz\") pod \"57bfd382-e2a8-4855-b7d5-c8814eb26802\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " Jun 10 12:57:41.983077 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.982993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-bundle\") pod \"57bfd382-e2a8-4855-b7d5-c8814eb26802\" (UID: \"57bfd382-e2a8-4855-b7d5-c8814eb26802\") " Jun 10 12:57:41.983739 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.983711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-bundle" (OuterVolumeSpecName: "bundle") pod "57bfd382-e2a8-4855-b7d5-c8814eb26802" (UID: "57bfd382-e2a8-4855-b7d5-c8814eb26802"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:57:41.985098 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.985076 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57bfd382-e2a8-4855-b7d5-c8814eb26802-kube-api-access-zf5zz" (OuterVolumeSpecName: "kube-api-access-zf5zz") pod "57bfd382-e2a8-4855-b7d5-c8814eb26802" (UID: "57bfd382-e2a8-4855-b7d5-c8814eb26802"). InnerVolumeSpecName "kube-api-access-zf5zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:57:41.987103 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:41.987077 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-util" (OuterVolumeSpecName: "util") pod "57bfd382-e2a8-4855-b7d5-c8814eb26802" (UID: "57bfd382-e2a8-4855-b7d5-c8814eb26802"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:57:42.083485 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:42.083455 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:57:42.083485 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:42.083483 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf5zz\" (UniqueName: \"kubernetes.io/projected/57bfd382-e2a8-4855-b7d5-c8814eb26802-kube-api-access-zf5zz\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:57:42.083485 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:42.083493 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57bfd382-e2a8-4855-b7d5-c8814eb26802-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:57:42.748045 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:42.748012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" event={"ID":"57bfd382-e2a8-4855-b7d5-c8814eb26802","Type":"ContainerDied","Data":"447fb1207d98da22fed652e32f2b48b7c56266e9ab5f4375c332dede90161c09"} Jun 10 12:57:42.748045 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:42.748049 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqbvjt" Jun 10 12:57:42.748240 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:42.748062 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="447fb1207d98da22fed652e32f2b48b7c56266e9ab5f4375c332dede90161c09" Jun 10 12:57:48.195960 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.195919 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm"] Jun 10 12:57:48.196494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196376 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="extract" Jun 10 12:57:48.196494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196395 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="extract" Jun 10 12:57:48.196494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196426 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="util" Jun 10 12:57:48.196494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196434 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="util" Jun 10 12:57:48.196494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196446 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="pull" Jun 10 12:57:48.196494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196456 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="pull" Jun 10 12:57:48.196792 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.196526 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="57bfd382-e2a8-4855-b7d5-c8814eb26802" containerName="extract" Jun 10 12:57:48.198903 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.198882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.201445 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.201421 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:57:48.201549 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.201502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p8bwp\"" Jun 10 12:57:48.201779 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.201763 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 12:57:48.214530 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.214502 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm"] Jun 10 12:57:48.331978 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.331937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04243909-2f96-4031-923c-13a89c1e3e15-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m7vpm\" (UID: \"04243909-2f96-4031-923c-13a89c1e3e15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.332165 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.332036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg65d\" (UniqueName: \"kubernetes.io/projected/04243909-2f96-4031-923c-13a89c1e3e15-kube-api-access-kg65d\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m7vpm\" (UID: \"04243909-2f96-4031-923c-13a89c1e3e15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.432445 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.432404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04243909-2f96-4031-923c-13a89c1e3e15-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m7vpm\" (UID: \"04243909-2f96-4031-923c-13a89c1e3e15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.432616 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.432504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg65d\" (UniqueName: \"kubernetes.io/projected/04243909-2f96-4031-923c-13a89c1e3e15-kube-api-access-kg65d\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m7vpm\" (UID: \"04243909-2f96-4031-923c-13a89c1e3e15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.432810 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.432788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04243909-2f96-4031-923c-13a89c1e3e15-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m7vpm\" (UID: \"04243909-2f96-4031-923c-13a89c1e3e15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.447544 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.447485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg65d\" (UniqueName: \"kubernetes.io/projected/04243909-2f96-4031-923c-13a89c1e3e15-kube-api-access-kg65d\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m7vpm\" (UID: \"04243909-2f96-4031-923c-13a89c1e3e15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.508145 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.508094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" Jun 10 12:57:48.679197 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.679165 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm"] Jun 10 12:57:48.701718 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:57:48.701687 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04243909_2f96_4031_923c_13a89c1e3e15.slice/crio-e8249364911425373d34f0f6f799238551017646d6db38ea8b9a84a4a43209bd WatchSource:0}: Error finding container e8249364911425373d34f0f6f799238551017646d6db38ea8b9a84a4a43209bd: Status 404 returned error can't find the container with id e8249364911425373d34f0f6f799238551017646d6db38ea8b9a84a4a43209bd Jun 10 12:57:48.772676 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:48.772646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" event={"ID":"04243909-2f96-4031-923c-13a89c1e3e15","Type":"ContainerStarted","Data":"e8249364911425373d34f0f6f799238551017646d6db38ea8b9a84a4a43209bd"} Jun 10 12:57:50.786532 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:50.786429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" event={"ID":"04243909-2f96-4031-923c-13a89c1e3e15","Type":"ContainerStarted","Data":"226e2deff428d1b85da9e71c76cae2c589741a4dc4f0b8fbf2ef17c322639625"} Jun 10 12:57:50.812952 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:50.812893 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m7vpm" podStartSLOduration=1.009620732 podStartE2EDuration="2.812878017s" totalImagesPullingTime="1.803257285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:50.811332203 +0000 UTC m=+525.376313954" watchObservedRunningTime="2026-06-10 12:57:50.812878017 +0000 UTC m=+525.377859766" Jun 10 12:57:52.640263 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.640225 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8"] Jun 10 12:57:52.642834 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.642818 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.646225 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.646203 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:57:52.646525 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.646510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:57:52.647063 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.647049 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-chjxg\"" Jun 10 12:57:52.655017 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.654992 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8"] Jun 10 12:57:52.766930 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.766897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.767084 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.766937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfz4\" (UniqueName: \"kubernetes.io/projected/82f1e9e5-3c21-42db-925e-8f48a386a41f-kube-api-access-qwfz4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.767084 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.766971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.868155 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.868121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.868390 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.868185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.868390 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.868204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfz4\" (UniqueName: \"kubernetes.io/projected/82f1e9e5-3c21-42db-925e-8f48a386a41f-kube-api-access-qwfz4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.868613 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.868591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.868687 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.868639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.880570 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.880544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfz4\" (UniqueName: \"kubernetes.io/projected/82f1e9e5-3c21-42db-925e-8f48a386a41f-kube-api-access-qwfz4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:52.951565 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:52.951486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:53.081428 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:53.081407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8"] Jun 10 12:57:53.083788 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:57:53.083761 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f1e9e5_3c21_42db_925e_8f48a386a41f.slice/crio-a9f97428697933f15306aa68e332589d247f5ac5daa716eb4442b6ad631cf858 WatchSource:0}: Error finding container a9f97428697933f15306aa68e332589d247f5ac5daa716eb4442b6ad631cf858: Status 404 returned error can't find the container with id a9f97428697933f15306aa68e332589d247f5ac5daa716eb4442b6ad631cf858 Jun 10 12:57:53.800274 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:53.800240 2576 generic.go:356] "Generic (PLEG): container finished" podID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerID="ea6615ddee6031ab73a10a8e169ae71d0097eaadd49a8b26d94d2551af6d85c0" exitCode=0 Jun 10 12:57:53.800772 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:53.800327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" event={"ID":"82f1e9e5-3c21-42db-925e-8f48a386a41f","Type":"ContainerDied","Data":"ea6615ddee6031ab73a10a8e169ae71d0097eaadd49a8b26d94d2551af6d85c0"} Jun 10 12:57:53.800772 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:53.800407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" event={"ID":"82f1e9e5-3c21-42db-925e-8f48a386a41f","Type":"ContainerStarted","Data":"a9f97428697933f15306aa68e332589d247f5ac5daa716eb4442b6ad631cf858"} Jun 10 12:57:56.814455 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.814420 2576 generic.go:356] "Generic (PLEG): container finished" podID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerID="c81fd4d66a1fb731a512c57b8863c309d9e9c914a177a12970524142e3e3a9bd" exitCode=0 Jun 10 12:57:56.814930 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.814484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" event={"ID":"82f1e9e5-3c21-42db-925e-8f48a386a41f","Type":"ContainerDied","Data":"c81fd4d66a1fb731a512c57b8863c309d9e9c914a177a12970524142e3e3a9bd"} Jun 10 12:57:56.868494 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.868467 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lck45"] Jun 10 12:57:56.871723 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.871705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:56.874539 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.874519 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 12:57:56.874539 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.874528 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 12:57:56.874722 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.874519 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cdbk6\"" Jun 10 12:57:56.884131 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:56.884109 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lck45"] Jun 10 12:57:57.003852 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.003826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e531b252-4104-4fe1-be9f-7d5302d8f0a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lck45\" (UID: \"e531b252-4104-4fe1-be9f-7d5302d8f0a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.004003 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.003875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48ckn\" (UniqueName: \"kubernetes.io/projected/e531b252-4104-4fe1-be9f-7d5302d8f0a4-kube-api-access-48ckn\") pod \"cert-manager-cainjector-5d99449ffd-lck45\" (UID: \"e531b252-4104-4fe1-be9f-7d5302d8f0a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.104408 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.104291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48ckn\" (UniqueName: \"kubernetes.io/projected/e531b252-4104-4fe1-be9f-7d5302d8f0a4-kube-api-access-48ckn\") pod \"cert-manager-cainjector-5d99449ffd-lck45\" (UID: \"e531b252-4104-4fe1-be9f-7d5302d8f0a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.104408 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.104375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e531b252-4104-4fe1-be9f-7d5302d8f0a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lck45\" (UID: \"e531b252-4104-4fe1-be9f-7d5302d8f0a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.113972 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.113940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e531b252-4104-4fe1-be9f-7d5302d8f0a4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lck45\" (UID: \"e531b252-4104-4fe1-be9f-7d5302d8f0a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.114069 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.113988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48ckn\" (UniqueName: \"kubernetes.io/projected/e531b252-4104-4fe1-be9f-7d5302d8f0a4-kube-api-access-48ckn\") pod \"cert-manager-cainjector-5d99449ffd-lck45\" (UID: \"e531b252-4104-4fe1-be9f-7d5302d8f0a4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.181150 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.181116 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" Jun 10 12:57:57.310956 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.310914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lck45"] Jun 10 12:57:57.313737 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:57:57.313710 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode531b252_4104_4fe1_be9f_7d5302d8f0a4.slice/crio-57ab1dbbb8c6af2ad63bf337a079ddc96da92f4432738dca016b79c32cb15498 WatchSource:0}: Error finding container 57ab1dbbb8c6af2ad63bf337a079ddc96da92f4432738dca016b79c32cb15498: Status 404 returned error can't find the container with id 57ab1dbbb8c6af2ad63bf337a079ddc96da92f4432738dca016b79c32cb15498 Jun 10 12:57:57.820669 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.820635 2576 generic.go:356] "Generic (PLEG): container finished" podID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerID="1a7a0e0d7ecd1a965f326d874ee47d18020507685f07571ef326efbdea8f9ebd" exitCode=0 Jun 10 12:57:57.821087 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.820709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" event={"ID":"82f1e9e5-3c21-42db-925e-8f48a386a41f","Type":"ContainerDied","Data":"1a7a0e0d7ecd1a965f326d874ee47d18020507685f07571ef326efbdea8f9ebd"} Jun 10 12:57:57.821906 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:57.821885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" event={"ID":"e531b252-4104-4fe1-be9f-7d5302d8f0a4","Type":"ContainerStarted","Data":"57ab1dbbb8c6af2ad63bf337a079ddc96da92f4432738dca016b79c32cb15498"} Jun 10 12:57:58.960787 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:58.960762 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:59.018400 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.018343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-util\") pod \"82f1e9e5-3c21-42db-925e-8f48a386a41f\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " Jun 10 12:57:59.018580 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.018439 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwfz4\" (UniqueName: \"kubernetes.io/projected/82f1e9e5-3c21-42db-925e-8f48a386a41f-kube-api-access-qwfz4\") pod \"82f1e9e5-3c21-42db-925e-8f48a386a41f\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " Jun 10 12:57:59.018580 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.018474 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-bundle\") pod \"82f1e9e5-3c21-42db-925e-8f48a386a41f\" (UID: \"82f1e9e5-3c21-42db-925e-8f48a386a41f\") " Jun 10 12:57:59.018989 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.018937 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-bundle" (OuterVolumeSpecName: "bundle") pod "82f1e9e5-3c21-42db-925e-8f48a386a41f" (UID: "82f1e9e5-3c21-42db-925e-8f48a386a41f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:57:59.021028 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.020988 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f1e9e5-3c21-42db-925e-8f48a386a41f-kube-api-access-qwfz4" (OuterVolumeSpecName: "kube-api-access-qwfz4") pod "82f1e9e5-3c21-42db-925e-8f48a386a41f" (UID: "82f1e9e5-3c21-42db-925e-8f48a386a41f"). InnerVolumeSpecName "kube-api-access-qwfz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:57:59.023791 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.023761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-util" (OuterVolumeSpecName: "util") pod "82f1e9e5-3c21-42db-925e-8f48a386a41f" (UID: "82f1e9e5-3c21-42db-925e-8f48a386a41f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:57:59.119832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.119737 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwfz4\" (UniqueName: \"kubernetes.io/projected/82f1e9e5-3c21-42db-925e-8f48a386a41f-kube-api-access-qwfz4\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:57:59.119832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.119778 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:57:59.119832 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.119789 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f1e9e5-3c21-42db-925e-8f48a386a41f-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:57:59.831724 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.831700 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" Jun 10 12:57:59.831826 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.831717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fczxq8" event={"ID":"82f1e9e5-3c21-42db-925e-8f48a386a41f","Type":"ContainerDied","Data":"a9f97428697933f15306aa68e332589d247f5ac5daa716eb4442b6ad631cf858"} Jun 10 12:57:59.831826 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:57:59.831763 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9f97428697933f15306aa68e332589d247f5ac5daa716eb4442b6ad631cf858" Jun 10 12:58:00.837820 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:00.837785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" event={"ID":"e531b252-4104-4fe1-be9f-7d5302d8f0a4","Type":"ContainerStarted","Data":"d48e5ce504c30d951047159456d2c0d9e4efca4b10b85bc16282e283272dcd76"} Jun 10 12:58:00.858608 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:00.858560 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lck45" podStartSLOduration=2.369328173 podStartE2EDuration="4.858542714s" totalImagesPullingTime="2.489214541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:58:00.857733727 +0000 UTC m=+535.422715488" watchObservedRunningTime="2026-06-10 12:58:00.858542714 +0000 UTC m=+535.423524464" Jun 10 12:58:11.867693 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867654 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz"] Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867929 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="pull" Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867940 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="pull" Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867954 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="util" Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867960 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="util" Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867969 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="extract" Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.867974 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="extract" Jun 10 12:58:11.868143 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.868014 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f1e9e5-3c21-42db-925e-8f48a386a41f" containerName="extract" Jun 10 12:58:11.873220 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.873198 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:11.875997 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.875976 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:58:11.876119 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.876008 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:58:11.876816 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.876798 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-chjxg\"" Jun 10 12:58:11.880718 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:11.880694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz"] Jun 10 12:58:12.024469 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.024430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.024651 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.024507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.024651 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.024535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcv9w\" (UniqueName: \"kubernetes.io/projected/83ceba74-d234-4600-b970-622f8febce17-kube-api-access-xcv9w\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.125829 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.125740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.125829 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.125809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.126048 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.125844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcv9w\" (UniqueName: \"kubernetes.io/projected/83ceba74-d234-4600-b970-622f8febce17-kube-api-access-xcv9w\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.126211 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.126185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.126272 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.126203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.135419 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.135397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcv9w\" (UniqueName: \"kubernetes.io/projected/83ceba74-d234-4600-b970-622f8febce17-kube-api-access-xcv9w\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.182945 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.182915 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:12.314036 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.313856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz"] Jun 10 12:58:12.316494 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:58:12.316462 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ceba74_d234_4600_b970_622f8febce17.slice/crio-d0f0df506878ec2862651398d187e27da7df30dd7306a6f2191ed9a1e0a34556 WatchSource:0}: Error finding container d0f0df506878ec2862651398d187e27da7df30dd7306a6f2191ed9a1e0a34556: Status 404 returned error can't find the container with id d0f0df506878ec2862651398d187e27da7df30dd7306a6f2191ed9a1e0a34556 Jun 10 12:58:12.888939 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.888903 2576 generic.go:356] "Generic (PLEG): container finished" podID="83ceba74-d234-4600-b970-622f8febce17" containerID="e899bf44accc64c5c7a9f043059651a658dfee2b6addceb0658edda6e1df63c1" exitCode=0 Jun 10 12:58:12.889332 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.888949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" event={"ID":"83ceba74-d234-4600-b970-622f8febce17","Type":"ContainerDied","Data":"e899bf44accc64c5c7a9f043059651a658dfee2b6addceb0658edda6e1df63c1"} Jun 10 12:58:12.889332 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:12.888982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" event={"ID":"83ceba74-d234-4600-b970-622f8febce17","Type":"ContainerStarted","Data":"d0f0df506878ec2862651398d187e27da7df30dd7306a6f2191ed9a1e0a34556"} Jun 10 12:58:13.894698 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:13.894663 2576 generic.go:356] "Generic (PLEG): container finished" podID="83ceba74-d234-4600-b970-622f8febce17" containerID="f72700752ec59cf968d564996e95d73533c1bee228ec14cd15a6919836f87c66" exitCode=0 Jun 10 12:58:13.895101 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:13.894742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" event={"ID":"83ceba74-d234-4600-b970-622f8febce17","Type":"ContainerDied","Data":"f72700752ec59cf968d564996e95d73533c1bee228ec14cd15a6919836f87c66"} Jun 10 12:58:14.900689 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:14.900653 2576 generic.go:356] "Generic (PLEG): container finished" podID="83ceba74-d234-4600-b970-622f8febce17" containerID="a1c6a3bfbd94ff13669f3e90ed45e4e2c721c87c08d72b67bca04f0d6b43e974" exitCode=0 Jun 10 12:58:14.901090 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:14.900716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" event={"ID":"83ceba74-d234-4600-b970-622f8febce17","Type":"ContainerDied","Data":"a1c6a3bfbd94ff13669f3e90ed45e4e2c721c87c08d72b67bca04f0d6b43e974"} Jun 10 12:58:16.042654 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.042625 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:16.159558 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.159449 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-util\") pod \"83ceba74-d234-4600-b970-622f8febce17\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " Jun 10 12:58:16.159558 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.159504 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-bundle\") pod \"83ceba74-d234-4600-b970-622f8febce17\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " Jun 10 12:58:16.159558 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.159550 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcv9w\" (UniqueName: \"kubernetes.io/projected/83ceba74-d234-4600-b970-622f8febce17-kube-api-access-xcv9w\") pod \"83ceba74-d234-4600-b970-622f8febce17\" (UID: \"83ceba74-d234-4600-b970-622f8febce17\") " Jun 10 12:58:16.160182 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.160156 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-bundle" (OuterVolumeSpecName: "bundle") pod "83ceba74-d234-4600-b970-622f8febce17" (UID: "83ceba74-d234-4600-b970-622f8febce17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:58:16.161632 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.161605 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ceba74-d234-4600-b970-622f8febce17-kube-api-access-xcv9w" (OuterVolumeSpecName: "kube-api-access-xcv9w") pod "83ceba74-d234-4600-b970-622f8febce17" (UID: "83ceba74-d234-4600-b970-622f8febce17"). InnerVolumeSpecName "kube-api-access-xcv9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:58:16.165161 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.165138 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-util" (OuterVolumeSpecName: "util") pod "83ceba74-d234-4600-b970-622f8febce17" (UID: "83ceba74-d234-4600-b970-622f8febce17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:58:16.260709 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.260669 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcv9w\" (UniqueName: \"kubernetes.io/projected/83ceba74-d234-4600-b970-622f8febce17-kube-api-access-xcv9w\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:58:16.260709 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.260703 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:58:16.260709 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.260715 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83ceba74-d234-4600-b970-622f8febce17-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:58:16.914211 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.914182 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" Jun 10 12:58:16.914211 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.914203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd74tsz" event={"ID":"83ceba74-d234-4600-b970-622f8febce17","Type":"ContainerDied","Data":"d0f0df506878ec2862651398d187e27da7df30dd7306a6f2191ed9a1e0a34556"} Jun 10 12:58:16.914438 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:16.914247 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0f0df506878ec2862651398d187e27da7df30dd7306a6f2191ed9a1e0a34556" Jun 10 12:58:29.308180 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308141 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj"] Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308593 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="util" Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308613 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="util" Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308637 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="pull" Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308647 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="pull" Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308656 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="extract" Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308666 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="extract" Jun 10 12:58:29.308838 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.308789 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ceba74-d234-4600-b970-622f8febce17" containerName="extract" Jun 10 12:58:29.311221 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.311200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.315023 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.314999 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:58:29.315126 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.315072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:58:29.315321 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.315304 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:58:29.315421 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.315402 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qv28b\"" Jun 10 12:58:29.315879 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.315866 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:58:29.345797 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.345762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj"] Jun 10 12:58:29.461837 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.461801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.462021 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.461848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-manifests\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.462021 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.461881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-tmp\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.462021 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.461900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5zf\" (UniqueName: \"kubernetes.io/projected/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-kube-api-access-2d5zf\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.462021 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.461919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.562533 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.562434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-manifests\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.562533 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.562472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-tmp\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.562533 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.562493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5zf\" (UniqueName: \"kubernetes.io/projected/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-kube-api-access-2d5zf\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.562822 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.562623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.562822 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.562714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.562934 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.562907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-manifests\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.564904 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.564873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-tmp\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.565088 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.565069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.565150 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.565079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.574115 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.574091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5zf\" (UniqueName: \"kubernetes.io/projected/4476c7c0-ad29-4ea6-91dd-7f081cdb8c13-kube-api-access-2d5zf\") pod \"opendatahub-operator-controller-manager-6bb4db9f45-lmggj\" (UID: \"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.622084 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.622045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:29.762376 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.762327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj"] Jun 10 12:58:29.765793 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:58:29.765767 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4476c7c0_ad29_4ea6_91dd_7f081cdb8c13.slice/crio-3eaeaf714aaf8b75bcf1d02022985408d9396eb4f9f455040972f344efa6ab7b WatchSource:0}: Error finding container 3eaeaf714aaf8b75bcf1d02022985408d9396eb4f9f455040972f344efa6ab7b: Status 404 returned error can't find the container with id 3eaeaf714aaf8b75bcf1d02022985408d9396eb4f9f455040972f344efa6ab7b Jun 10 12:58:29.967623 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:29.967540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" event={"ID":"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13","Type":"ContainerStarted","Data":"3eaeaf714aaf8b75bcf1d02022985408d9396eb4f9f455040972f344efa6ab7b"} Jun 10 12:58:32.990016 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:32.989980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" event={"ID":"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13","Type":"ContainerStarted","Data":"1aacad9ffdebc96af8d6f9d61e731c4d245283420da996b7937b5a11eb6204fa"} Jun 10 12:58:33.995982 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:33.995949 2576 generic.go:356] "Generic (PLEG): container finished" podID="4476c7c0-ad29-4ea6-91dd-7f081cdb8c13" containerID="1aacad9ffdebc96af8d6f9d61e731c4d245283420da996b7937b5a11eb6204fa" exitCode=0 Jun 10 12:58:33.996408 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:33.995998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" event={"ID":"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13","Type":"ContainerDied","Data":"1aacad9ffdebc96af8d6f9d61e731c4d245283420da996b7937b5a11eb6204fa"} Jun 10 12:58:35.001783 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:35.001747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" event={"ID":"4476c7c0-ad29-4ea6-91dd-7f081cdb8c13","Type":"ContainerStarted","Data":"2eef8be20caf3ea52b37a3c89960875efffb795bb5407e3c1771821a691f7eb2"} Jun 10 12:58:35.002248 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:35.001857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:35.033702 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:35.033653 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" podStartSLOduration=2.057842913 podStartE2EDuration="6.033636774s" totalImagesPullingTime="2.937005021s" totalInitContainerRuntime="1.03878884s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:58:35.032197348 +0000 UTC m=+569.597179110" watchObservedRunningTime="2026-06-10 12:58:35.033636774 +0000 UTC m=+569.598618523" Jun 10 12:58:46.007829 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:46.007801 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb4db9f45-lmggj" Jun 10 12:58:48.113661 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.113624 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk"] Jun 10 12:58:48.124315 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.124285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.126948 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.126925 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 12:58:48.127619 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.127597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mgd4k\"" Jun 10 12:58:48.127725 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.127648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 12:58:48.127882 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.127868 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 12:58:48.127981 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.127963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 12:58:48.132239 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.132215 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk"] Jun 10 12:58:48.204735 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.204699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3da7500-85af-446f-b6bf-bcfec8648f51-tls-certs\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.204735 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.204732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3da7500-85af-446f-b6bf-bcfec8648f51-tmp\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.204946 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.204761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2kq\" (UniqueName: \"kubernetes.io/projected/c3da7500-85af-446f-b6bf-bcfec8648f51-kube-api-access-nx2kq\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.254049 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.254016 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p"] Jun 10 12:58:48.259735 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.259711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.263577 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.263554 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:58:48.263577 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.263566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-chjxg\"" Jun 10 12:58:48.263834 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.263821 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:58:48.271862 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.271838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p"] Jun 10 12:58:48.305865 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.305839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhxqh\" (UniqueName: \"kubernetes.io/projected/266a6571-05be-4676-9272-48bdef2ab054-kube-api-access-dhxqh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.306014 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.305880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.306014 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.305905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3da7500-85af-446f-b6bf-bcfec8648f51-tls-certs\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.306014 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.305940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3da7500-85af-446f-b6bf-bcfec8648f51-tmp\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.306014 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.305994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2kq\" (UniqueName: \"kubernetes.io/projected/c3da7500-85af-446f-b6bf-bcfec8648f51-kube-api-access-nx2kq\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.306206 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.306022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.308185 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.308154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3da7500-85af-446f-b6bf-bcfec8648f51-tmp\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.308333 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.308319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3da7500-85af-446f-b6bf-bcfec8648f51-tls-certs\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.324473 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.324447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2kq\" (UniqueName: \"kubernetes.io/projected/c3da7500-85af-446f-b6bf-bcfec8648f51-kube-api-access-nx2kq\") pod \"kube-auth-proxy-7b87c4dc87-lwkpk\" (UID: \"c3da7500-85af-446f-b6bf-bcfec8648f51\") " pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.407435 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.407342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.407584 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.407444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.407584 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.407485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhxqh\" (UniqueName: \"kubernetes.io/projected/266a6571-05be-4676-9272-48bdef2ab054-kube-api-access-dhxqh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.407738 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.407719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.407833 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.407797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.420866 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.420842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhxqh\" (UniqueName: \"kubernetes.io/projected/266a6571-05be-4676-9272-48bdef2ab054-kube-api-access-dhxqh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.435684 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.435627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" Jun 10 12:58:48.568869 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.568831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:48.595727 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.595697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk"] Jun 10 12:58:48.596771 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:58:48.596736 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3da7500_85af_446f_b6bf_bcfec8648f51.slice/crio-ddfe283166613a90dd23663193419c4f445c27fdaca8f23c2ce4cf950acd9ed7 WatchSource:0}: Error finding container ddfe283166613a90dd23663193419c4f445c27fdaca8f23c2ce4cf950acd9ed7: Status 404 returned error can't find the container with id ddfe283166613a90dd23663193419c4f445c27fdaca8f23c2ce4cf950acd9ed7 Jun 10 12:58:48.739098 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:48.738981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p"] Jun 10 12:58:48.741941 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:58:48.741915 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266a6571_05be_4676_9272_48bdef2ab054.slice/crio-410f12c8e3953fb06292c110f984ce7fef9f8ae4265849f42477828d8819211d WatchSource:0}: Error finding container 410f12c8e3953fb06292c110f984ce7fef9f8ae4265849f42477828d8819211d: Status 404 returned error can't find the container with id 410f12c8e3953fb06292c110f984ce7fef9f8ae4265849f42477828d8819211d Jun 10 12:58:49.069413 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.069381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" event={"ID":"c3da7500-85af-446f-b6bf-bcfec8648f51","Type":"ContainerStarted","Data":"ddfe283166613a90dd23663193419c4f445c27fdaca8f23c2ce4cf950acd9ed7"} Jun 10 12:58:49.070876 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.070848 2576 generic.go:356] "Generic (PLEG): container finished" podID="266a6571-05be-4676-9272-48bdef2ab054" containerID="eb5d3d06c88552ea30060b43e82270c9ead0b4393d55d2641731653c405d16e0" exitCode=0 Jun 10 12:58:49.070989 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.070926 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" event={"ID":"266a6571-05be-4676-9272-48bdef2ab054","Type":"ContainerDied","Data":"eb5d3d06c88552ea30060b43e82270c9ead0b4393d55d2641731653c405d16e0"} Jun 10 12:58:49.070989 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.070966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" event={"ID":"266a6571-05be-4676-9272-48bdef2ab054","Type":"ContainerStarted","Data":"410f12c8e3953fb06292c110f984ce7fef9f8ae4265849f42477828d8819211d"} Jun 10 12:58:49.521819 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.521464 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xg49q"] Jun 10 12:58:49.524536 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.524510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:49.527267 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.527241 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-qbn6t\"" Jun 10 12:58:49.527565 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.527548 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 12:58:49.537177 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.537146 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xg49q"] Jun 10 12:58:49.618580 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.618535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwcg8\" (UniqueName: \"kubernetes.io/projected/a4a25020-0bf6-404c-8018-d9ff9a886904-kube-api-access-mwcg8\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:49.618823 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.618662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a25020-0bf6-404c-8018-d9ff9a886904-tls-certs\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:49.719756 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.719720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a25020-0bf6-404c-8018-d9ff9a886904-tls-certs\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:49.719938 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.719791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwcg8\" (UniqueName: \"kubernetes.io/projected/a4a25020-0bf6-404c-8018-d9ff9a886904-kube-api-access-mwcg8\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:49.720067 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:58:49.720044 2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 10 12:58:49.720143 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:58:49.720125 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a25020-0bf6-404c-8018-d9ff9a886904-tls-certs podName:a4a25020-0bf6-404c-8018-d9ff9a886904 nodeName:}" failed. No retries permitted until 2026-06-10 12:58:50.220101909 +0000 UTC m=+584.785083654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a4a25020-0bf6-404c-8018-d9ff9a886904-tls-certs") pod "model-serving-api-5dd488fc48-xg49q" (UID: "a4a25020-0bf6-404c-8018-d9ff9a886904") : secret "model-serving-api-tls" not found Jun 10 12:58:49.736923 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:49.736890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwcg8\" (UniqueName: \"kubernetes.io/projected/a4a25020-0bf6-404c-8018-d9ff9a886904-kube-api-access-mwcg8\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:50.079184 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:50.079146 2576 generic.go:356] "Generic (PLEG): container finished" podID="266a6571-05be-4676-9272-48bdef2ab054" containerID="878cdb5b117d9917bc95f50a36caca6404b4e3d06dbcb53096b3f9af7598c099" exitCode=0 Jun 10 12:58:50.079400 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:50.079228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" event={"ID":"266a6571-05be-4676-9272-48bdef2ab054","Type":"ContainerDied","Data":"878cdb5b117d9917bc95f50a36caca6404b4e3d06dbcb53096b3f9af7598c099"} Jun 10 12:58:50.225679 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:50.225646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a25020-0bf6-404c-8018-d9ff9a886904-tls-certs\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:50.228226 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:50.228201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a25020-0bf6-404c-8018-d9ff9a886904-tls-certs\") pod \"model-serving-api-5dd488fc48-xg49q\" (UID: \"a4a25020-0bf6-404c-8018-d9ff9a886904\") " pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:50.440459 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:50.440357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:51.429568 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:51.429547 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xg49q"] Jun 10 12:58:52.090860 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:52.090816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" event={"ID":"c3da7500-85af-446f-b6bf-bcfec8648f51","Type":"ContainerStarted","Data":"579742a8f219b277aaf0aa6ea877d0f8ca8ae25f4731133725e01b2fd42e40c9"} Jun 10 12:58:52.092985 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:52.092954 2576 generic.go:356] "Generic (PLEG): container finished" podID="266a6571-05be-4676-9272-48bdef2ab054" containerID="9542f1d4e94486ae84b345fbcf525091c56897a7d7843a53419d11a7d3a2c9a4" exitCode=0 Jun 10 12:58:52.093116 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:52.093038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" event={"ID":"266a6571-05be-4676-9272-48bdef2ab054","Type":"ContainerDied","Data":"9542f1d4e94486ae84b345fbcf525091c56897a7d7843a53419d11a7d3a2c9a4"} Jun 10 12:58:52.094249 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:52.094225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" event={"ID":"a4a25020-0bf6-404c-8018-d9ff9a886904","Type":"ContainerStarted","Data":"806def3f698dab55614044f1f973e083f25bedc3c53130ffc6c37181592568fe"} Jun 10 12:58:52.120563 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:52.120512 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b87c4dc87-lwkpk" podStartSLOduration=1.369257349 podStartE2EDuration="4.120495949s" totalImagesPullingTime="2.7512386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:58:52.120390308 +0000 UTC m=+586.685372060" watchObservedRunningTime="2026-06-10 12:58:52.120495949 +0000 UTC m=+586.685477698" Jun 10 12:58:53.100045 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.100014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" event={"ID":"a4a25020-0bf6-404c-8018-d9ff9a886904","Type":"ContainerStarted","Data":"8c528c6d9ea91991a8823163e66278b7c9e4db4cd60c1177fd1ec2a7ae7b3c48"} Jun 10 12:58:53.100501 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.100321 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:58:53.131039 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.130980 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" podStartSLOduration=2.658456443 podStartE2EDuration="4.130961847s" totalImagesPullingTime="1.472505404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:58:53.12887666 +0000 UTC m=+587.693858641" watchObservedRunningTime="2026-06-10 12:58:53.130961847 +0000 UTC m=+587.695943597" Jun 10 12:58:53.227661 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.227638 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:53.352148 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.352112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-bundle\") pod \"266a6571-05be-4676-9272-48bdef2ab054\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " Jun 10 12:58:53.352367 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.352183 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhxqh\" (UniqueName: \"kubernetes.io/projected/266a6571-05be-4676-9272-48bdef2ab054-kube-api-access-dhxqh\") pod \"266a6571-05be-4676-9272-48bdef2ab054\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " Jun 10 12:58:53.352367 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.352230 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-util\") pod \"266a6571-05be-4676-9272-48bdef2ab054\" (UID: \"266a6571-05be-4676-9272-48bdef2ab054\") " Jun 10 12:58:53.352991 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.352967 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-bundle" (OuterVolumeSpecName: "bundle") pod "266a6571-05be-4676-9272-48bdef2ab054" (UID: "266a6571-05be-4676-9272-48bdef2ab054"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:58:53.354376 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.354325 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266a6571-05be-4676-9272-48bdef2ab054-kube-api-access-dhxqh" (OuterVolumeSpecName: "kube-api-access-dhxqh") pod "266a6571-05be-4676-9272-48bdef2ab054" (UID: "266a6571-05be-4676-9272-48bdef2ab054"). InnerVolumeSpecName "kube-api-access-dhxqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:58:53.357006 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.356985 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-util" (OuterVolumeSpecName: "util") pod "266a6571-05be-4676-9272-48bdef2ab054" (UID: "266a6571-05be-4676-9272-48bdef2ab054"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:58:53.453410 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.453373 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:58:53.453410 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.453403 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhxqh\" (UniqueName: \"kubernetes.io/projected/266a6571-05be-4676-9272-48bdef2ab054-kube-api-access-dhxqh\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:58:53.453410 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:53.453415 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266a6571-05be-4676-9272-48bdef2ab054-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:58:54.105964 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:54.105939 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" Jun 10 12:58:54.106372 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:54.105969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h8c4p" event={"ID":"266a6571-05be-4676-9272-48bdef2ab054","Type":"ContainerDied","Data":"410f12c8e3953fb06292c110f984ce7fef9f8ae4265849f42477828d8819211d"} Jun 10 12:58:54.106372 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:54.106016 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="410f12c8e3953fb06292c110f984ce7fef9f8ae4265849f42477828d8819211d" Jun 10 12:58:59.867661 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867626 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7g9pl"] Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867949 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="pull" Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867961 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="pull" Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867970 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="extract" Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867976 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="extract" Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867988 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="util" Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.867995 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="util" Jun 10 12:58:59.868137 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.868069 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="266a6571-05be-4676-9272-48bdef2ab054" containerName="extract" Jun 10 12:58:59.870913 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.870890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:58:59.874227 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.874203 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 12:58:59.874374 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.874296 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5zzpn\"" Jun 10 12:58:59.881025 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.881002 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m"] Jun 10 12:58:59.887949 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.887232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:58:59.887949 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.887719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7g9pl"] Jun 10 12:58:59.890712 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.890687 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t4w42\"" Jun 10 12:58:59.890906 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.890892 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 12:58:59.902570 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.902536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m"] Jun 10 12:58:59.905757 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.905728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-487ms\" (UniqueName: \"kubernetes.io/projected/b20f08e8-0b69-45e2-aae3-4073fd67a04a-kube-api-access-487ms\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:58:59.905878 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:58:59.905855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20f08e8-0b69-45e2-aae3-4073fd67a04a-cert\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.006740 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.006699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20f08e8-0b69-45e2-aae3-4073fd67a04a-cert\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.006950 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.006747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-487ms\" (UniqueName: \"kubernetes.io/projected/b20f08e8-0b69-45e2-aae3-4073fd67a04a-kube-api-access-487ms\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.006950 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.006775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/988d6e78-82df-4733-a09c-2e9c5c1012a8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-24t8m\" (UID: \"988d6e78-82df-4733-a09c-2e9c5c1012a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.006950 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.006798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjhc\" (UniqueName: \"kubernetes.io/projected/988d6e78-82df-4733-a09c-2e9c5c1012a8-kube-api-access-zfjhc\") pod \"llmisvc-controller-manager-864bfd7bc9-24t8m\" (UID: \"988d6e78-82df-4733-a09c-2e9c5c1012a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.006950 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:59:00.006853 2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 10 12:59:00.006950 ip-10-0-128-84 kubenswrapper[2576]: E0610 12:59:00.006914 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20f08e8-0b69-45e2-aae3-4073fd67a04a-cert podName:b20f08e8-0b69-45e2-aae3-4073fd67a04a nodeName:}" failed. No retries permitted until 2026-06-10 12:59:00.506896609 +0000 UTC m=+595.071878337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b20f08e8-0b69-45e2-aae3-4073fd67a04a-cert") pod "kserve-controller-manager-69fc866d76-7g9pl" (UID: "b20f08e8-0b69-45e2-aae3-4073fd67a04a") : secret "kserve-webhook-server-cert" not found Jun 10 12:59:00.033815 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.033780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-487ms\" (UniqueName: \"kubernetes.io/projected/b20f08e8-0b69-45e2-aae3-4073fd67a04a-kube-api-access-487ms\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.108175 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.108138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/988d6e78-82df-4733-a09c-2e9c5c1012a8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-24t8m\" (UID: \"988d6e78-82df-4733-a09c-2e9c5c1012a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.108175 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.108183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjhc\" (UniqueName: \"kubernetes.io/projected/988d6e78-82df-4733-a09c-2e9c5c1012a8-kube-api-access-zfjhc\") pod \"llmisvc-controller-manager-864bfd7bc9-24t8m\" (UID: \"988d6e78-82df-4733-a09c-2e9c5c1012a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.114366 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.111195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/988d6e78-82df-4733-a09c-2e9c5c1012a8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-24t8m\" (UID: \"988d6e78-82df-4733-a09c-2e9c5c1012a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.138825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.138758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjhc\" (UniqueName: \"kubernetes.io/projected/988d6e78-82df-4733-a09c-2e9c5c1012a8-kube-api-access-zfjhc\") pod \"llmisvc-controller-manager-864bfd7bc9-24t8m\" (UID: \"988d6e78-82df-4733-a09c-2e9c5c1012a8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.198855 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.198817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:00.350559 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.350479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m"] Jun 10 12:59:00.353115 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:59:00.353089 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod988d6e78_82df_4733_a09c_2e9c5c1012a8.slice/crio-885d4ca9b91f424343087b8603f9f5efec08f5042460a2b0d862dec1394f8f9f WatchSource:0}: Error finding container 885d4ca9b91f424343087b8603f9f5efec08f5042460a2b0d862dec1394f8f9f: Status 404 returned error can't find the container with id 885d4ca9b91f424343087b8603f9f5efec08f5042460a2b0d862dec1394f8f9f Jun 10 12:59:00.511409 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.511300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20f08e8-0b69-45e2-aae3-4073fd67a04a-cert\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.513684 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.513656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20f08e8-0b69-45e2-aae3-4073fd67a04a-cert\") pod \"kserve-controller-manager-69fc866d76-7g9pl\" (UID: \"b20f08e8-0b69-45e2-aae3-4073fd67a04a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.781300 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.781213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:00.928289 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:00.928263 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7g9pl"] Jun 10 12:59:00.930609 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:59:00.930578 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20f08e8_0b69_45e2_aae3_4073fd67a04a.slice/crio-a1c43cea113f242eecc04834bd99acefec4083b6d43d09603f961684a61a6ed1 WatchSource:0}: Error finding container a1c43cea113f242eecc04834bd99acefec4083b6d43d09603f961684a61a6ed1: Status 404 returned error can't find the container with id a1c43cea113f242eecc04834bd99acefec4083b6d43d09603f961684a61a6ed1 Jun 10 12:59:01.139802 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:01.139760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" event={"ID":"b20f08e8-0b69-45e2-aae3-4073fd67a04a","Type":"ContainerStarted","Data":"a1c43cea113f242eecc04834bd99acefec4083b6d43d09603f961684a61a6ed1"} Jun 10 12:59:01.141070 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:01.141040 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" event={"ID":"988d6e78-82df-4733-a09c-2e9c5c1012a8","Type":"ContainerStarted","Data":"885d4ca9b91f424343087b8603f9f5efec08f5042460a2b0d862dec1394f8f9f"} Jun 10 12:59:02.635703 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.635665 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464"] Jun 10 12:59:02.639802 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.639776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.645825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.645594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:59:02.645825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.645653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:59:02.646573 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.646394 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-chjxg\"" Jun 10 12:59:02.652163 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.652137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464"] Jun 10 12:59:02.733497 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.733453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lht25\" (UniqueName: \"kubernetes.io/projected/2c6cd27d-8655-42e6-8a30-45545685771b-kube-api-access-lht25\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.733686 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.733511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.733686 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.733573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.834465 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.834428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lht25\" (UniqueName: \"kubernetes.io/projected/2c6cd27d-8655-42e6-8a30-45545685771b-kube-api-access-lht25\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.834465 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.834468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.834666 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.834509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.834920 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.834898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.834955 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.834911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.867679 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.867639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lht25\" (UniqueName: \"kubernetes.io/projected/2c6cd27d-8655-42e6-8a30-45545685771b-kube-api-access-lht25\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:02.953063 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:02.952917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:04.110081 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.110056 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-xg49q" Jun 10 12:59:04.167181 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.167132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" event={"ID":"b20f08e8-0b69-45e2-aae3-4073fd67a04a","Type":"ContainerStarted","Data":"886c84ba1e3899e6cce8041f4dffec36616229651170ddbe49b6621f2b1908ad"} Jun 10 12:59:04.167568 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.167550 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:04.169105 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.169081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" event={"ID":"988d6e78-82df-4733-a09c-2e9c5c1012a8","Type":"ContainerStarted","Data":"f4b5a657a71c91c793fd17497ebdee2628f66a396b2b9e8118679e0e9ed01e8a"} Jun 10 12:59:04.169244 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.169230 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:04.215920 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.215865 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" podStartSLOduration=2.081349068 podStartE2EDuration="5.215848395s" totalImagesPullingTime="3.134499327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:59:04.212700306 +0000 UTC m=+598.777682057" watchObservedRunningTime="2026-06-10 12:59:04.215848395 +0000 UTC m=+598.780830144" Jun 10 12:59:04.239758 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:04.239722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464"] Jun 10 12:59:04.242879 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:59:04.242855 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6cd27d_8655_42e6_8a30_45545685771b.slice/crio-6d222d9ff5c4774ee831e0e8dd55ba927c9ff3c690f07edb74e1345681237649 WatchSource:0}: Error finding container 6d222d9ff5c4774ee831e0e8dd55ba927c9ff3c690f07edb74e1345681237649: Status 404 returned error can't find the container with id 6d222d9ff5c4774ee831e0e8dd55ba927c9ff3c690f07edb74e1345681237649 Jun 10 12:59:05.175273 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:05.175242 2576 generic.go:356] "Generic (PLEG): container finished" podID="2c6cd27d-8655-42e6-8a30-45545685771b" containerID="6229c14e778c9256facd0c888ec282b65af29b59fc76f33ecc3b9fe82c2b28a8" exitCode=0 Jun 10 12:59:05.175764 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:05.175316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" event={"ID":"2c6cd27d-8655-42e6-8a30-45545685771b","Type":"ContainerDied","Data":"6229c14e778c9256facd0c888ec282b65af29b59fc76f33ecc3b9fe82c2b28a8"} Jun 10 12:59:05.175764 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:05.175371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" event={"ID":"2c6cd27d-8655-42e6-8a30-45545685771b","Type":"ContainerStarted","Data":"6d222d9ff5c4774ee831e0e8dd55ba927c9ff3c690f07edb74e1345681237649"} Jun 10 12:59:05.206671 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:05.206616 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" podStartSLOduration=2.487977555 podStartE2EDuration="6.206598395s" totalImagesPullingTime="3.71862084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:59:04.245371382 +0000 UTC m=+598.810353145" watchObservedRunningTime="2026-06-10 12:59:05.206598395 +0000 UTC m=+599.771580169" Jun 10 12:59:05.916063 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:05.916032 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:59:05.916246 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:05.916038 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 12:59:06.002731 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.002708 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dd7b5d84c-pkr22"] Jun 10 12:59:06.007086 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.007068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.012011 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.011988 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m87gb\"" Jun 10 12:59:06.012011 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.012007 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 12:59:06.020960 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.020938 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dd7b5d84c-pkr22"] Jun 10 12:59:06.062771 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.062748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdf2x\" (UniqueName: \"kubernetes.io/projected/e7110c7b-1233-4477-8e00-b6454107c349-kube-api-access-rdf2x\") pod \"dashboard-redirect-dd7b5d84c-pkr22\" (UID: \"e7110c7b-1233-4477-8e00-b6454107c349\") " pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.062889 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.062800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e7110c7b-1233-4477-8e00-b6454107c349-redirect-config\") pod \"dashboard-redirect-dd7b5d84c-pkr22\" (UID: \"e7110c7b-1233-4477-8e00-b6454107c349\") " pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.164756 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.164709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdf2x\" (UniqueName: \"kubernetes.io/projected/e7110c7b-1233-4477-8e00-b6454107c349-kube-api-access-rdf2x\") pod \"dashboard-redirect-dd7b5d84c-pkr22\" (UID: \"e7110c7b-1233-4477-8e00-b6454107c349\") " pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.164948 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.164812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e7110c7b-1233-4477-8e00-b6454107c349-redirect-config\") pod \"dashboard-redirect-dd7b5d84c-pkr22\" (UID: \"e7110c7b-1233-4477-8e00-b6454107c349\") " pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.170176 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.170099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e7110c7b-1233-4477-8e00-b6454107c349-redirect-config\") pod \"dashboard-redirect-dd7b5d84c-pkr22\" (UID: \"e7110c7b-1233-4477-8e00-b6454107c349\") " pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.181593 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.181565 2576 generic.go:356] "Generic (PLEG): container finished" podID="2c6cd27d-8655-42e6-8a30-45545685771b" containerID="7296e0e8115180dd435420c507cb067bf4609740ea3818cac1635ee5c9536345" exitCode=0 Jun 10 12:59:06.182033 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.181655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" event={"ID":"2c6cd27d-8655-42e6-8a30-45545685771b","Type":"ContainerDied","Data":"7296e0e8115180dd435420c507cb067bf4609740ea3818cac1635ee5c9536345"} Jun 10 12:59:06.182033 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.182017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdf2x\" (UniqueName: \"kubernetes.io/projected/e7110c7b-1233-4477-8e00-b6454107c349-kube-api-access-rdf2x\") pod \"dashboard-redirect-dd7b5d84c-pkr22\" (UID: \"e7110c7b-1233-4477-8e00-b6454107c349\") " pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.318636 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.318603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" Jun 10 12:59:06.469334 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:06.469254 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dd7b5d84c-pkr22"] Jun 10 12:59:06.472134 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:59:06.472102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7110c7b_1233_4477_8e00_b6454107c349.slice/crio-ff43c18761bbf80aeacc52466ab876c415a33e1f5860b172d1eeedf555f9316d WatchSource:0}: Error finding container ff43c18761bbf80aeacc52466ab876c415a33e1f5860b172d1eeedf555f9316d: Status 404 returned error can't find the container with id ff43c18761bbf80aeacc52466ab876c415a33e1f5860b172d1eeedf555f9316d Jun 10 12:59:07.188707 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.188671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" event={"ID":"e7110c7b-1233-4477-8e00-b6454107c349","Type":"ContainerStarted","Data":"ff43c18761bbf80aeacc52466ab876c415a33e1f5860b172d1eeedf555f9316d"} Jun 10 12:59:07.190960 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.190939 2576 generic.go:356] "Generic (PLEG): container finished" podID="2c6cd27d-8655-42e6-8a30-45545685771b" containerID="4221440d265f1a90f23a30c64d3f809b894e226691a7acc8bdc0afc152bcc041" exitCode=0 Jun 10 12:59:07.191052 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.191020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" event={"ID":"2c6cd27d-8655-42e6-8a30-45545685771b","Type":"ContainerDied","Data":"4221440d265f1a90f23a30c64d3f809b894e226691a7acc8bdc0afc152bcc041"} Jun 10 12:59:07.472939 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.472848 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr"] Jun 10 12:59:07.476939 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.476912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.480965 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.480731 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 12:59:07.481099 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.481069 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 12:59:07.481504 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.481279 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-89r8n\"" Jun 10 12:59:07.494144 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.494083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr"] Jun 10 12:59:07.576480 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.576446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnh5\" (UniqueName: \"kubernetes.io/projected/e62cb9a0-6277-4e41-87f6-45ab8852bd05-kube-api-access-jmnh5\") pod \"servicemesh-operator3-57f65f65fb-9bnlr\" (UID: \"e62cb9a0-6277-4e41-87f6-45ab8852bd05\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.576681 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.576498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e62cb9a0-6277-4e41-87f6-45ab8852bd05-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9bnlr\" (UID: \"e62cb9a0-6277-4e41-87f6-45ab8852bd05\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.677859 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.677815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnh5\" (UniqueName: \"kubernetes.io/projected/e62cb9a0-6277-4e41-87f6-45ab8852bd05-kube-api-access-jmnh5\") pod \"servicemesh-operator3-57f65f65fb-9bnlr\" (UID: \"e62cb9a0-6277-4e41-87f6-45ab8852bd05\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.678048 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.677902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e62cb9a0-6277-4e41-87f6-45ab8852bd05-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9bnlr\" (UID: \"e62cb9a0-6277-4e41-87f6-45ab8852bd05\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.684294 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.684262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e62cb9a0-6277-4e41-87f6-45ab8852bd05-operator-config\") pod \"servicemesh-operator3-57f65f65fb-9bnlr\" (UID: \"e62cb9a0-6277-4e41-87f6-45ab8852bd05\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.690591 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.690536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnh5\" (UniqueName: \"kubernetes.io/projected/e62cb9a0-6277-4e41-87f6-45ab8852bd05-kube-api-access-jmnh5\") pod \"servicemesh-operator3-57f65f65fb-9bnlr\" (UID: \"e62cb9a0-6277-4e41-87f6-45ab8852bd05\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.793797 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.793712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:07.990958 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:07.990926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr"] Jun 10 12:59:07.997093 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:59:07.997063 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62cb9a0_6277_4e41_87f6_45ab8852bd05.slice/crio-ca3cf245d14071e99793e37bebd19a0d6c0bcb0590a53329a7fc3caa551b139b WatchSource:0}: Error finding container ca3cf245d14071e99793e37bebd19a0d6c0bcb0590a53329a7fc3caa551b139b: Status 404 returned error can't find the container with id ca3cf245d14071e99793e37bebd19a0d6c0bcb0590a53329a7fc3caa551b139b Jun 10 12:59:08.199430 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.199393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" event={"ID":"e62cb9a0-6277-4e41-87f6-45ab8852bd05","Type":"ContainerStarted","Data":"ca3cf245d14071e99793e37bebd19a0d6c0bcb0590a53329a7fc3caa551b139b"} Jun 10 12:59:08.346588 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.346560 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:08.485751 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.485671 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lht25\" (UniqueName: \"kubernetes.io/projected/2c6cd27d-8655-42e6-8a30-45545685771b-kube-api-access-lht25\") pod \"2c6cd27d-8655-42e6-8a30-45545685771b\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " Jun 10 12:59:08.485917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.485763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-util\") pod \"2c6cd27d-8655-42e6-8a30-45545685771b\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " Jun 10 12:59:08.485917 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.485810 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-bundle\") pod \"2c6cd27d-8655-42e6-8a30-45545685771b\" (UID: \"2c6cd27d-8655-42e6-8a30-45545685771b\") " Jun 10 12:59:08.486943 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.486910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-bundle" (OuterVolumeSpecName: "bundle") pod "2c6cd27d-8655-42e6-8a30-45545685771b" (UID: "2c6cd27d-8655-42e6-8a30-45545685771b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:59:08.488492 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.488458 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6cd27d-8655-42e6-8a30-45545685771b-kube-api-access-lht25" (OuterVolumeSpecName: "kube-api-access-lht25") pod "2c6cd27d-8655-42e6-8a30-45545685771b" (UID: "2c6cd27d-8655-42e6-8a30-45545685771b"). InnerVolumeSpecName "kube-api-access-lht25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:59:08.493776 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.493745 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-util" (OuterVolumeSpecName: "util") pod "2c6cd27d-8655-42e6-8a30-45545685771b" (UID: "2c6cd27d-8655-42e6-8a30-45545685771b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:59:08.586604 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.586567 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:59:08.586604 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.586598 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lht25\" (UniqueName: \"kubernetes.io/projected/2c6cd27d-8655-42e6-8a30-45545685771b-kube-api-access-lht25\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:59:08.586604 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:08.586612 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c6cd27d-8655-42e6-8a30-45545685771b-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 12:59:09.207358 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:09.207305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" event={"ID":"2c6cd27d-8655-42e6-8a30-45545685771b","Type":"ContainerDied","Data":"6d222d9ff5c4774ee831e0e8dd55ba927c9ff3c690f07edb74e1345681237649"} Jun 10 12:59:09.207759 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:09.207392 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d222d9ff5c4774ee831e0e8dd55ba927c9ff3c690f07edb74e1345681237649" Jun 10 12:59:09.207759 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:09.207316 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7s464" Jun 10 12:59:12.224932 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:12.224885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" event={"ID":"e7110c7b-1233-4477-8e00-b6454107c349","Type":"ContainerStarted","Data":"b5edb3f8ff20b80b6c02b56bc66f33143c60f5e7a44c276ab7424cd72820fd24"} Jun 10 12:59:12.329855 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:12.329802 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dd7b5d84c-pkr22" podStartSLOduration=2.614751827 podStartE2EDuration="7.329784955s" totalImagesPullingTime="4.715033128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:59:12.324923703 +0000 UTC m=+606.889905452" watchObservedRunningTime="2026-06-10 12:59:12.329784955 +0000 UTC m=+606.894766704" Jun 10 12:59:15.248825 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:15.248784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" event={"ID":"e62cb9a0-6277-4e41-87f6-45ab8852bd05","Type":"ContainerStarted","Data":"9d3446881595a3b551204b8d2bb0fbb933ba2d2ce52d00e78c4eb7a8df33de82"} Jun 10 12:59:15.249293 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:15.248938 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:15.276000 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:15.275949 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" podStartSLOduration=1.57345063 podStartE2EDuration="8.275929753s" totalImagesPullingTime="6.702479123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:59:15.273883505 +0000 UTC m=+609.838865274" watchObservedRunningTime="2026-06-10 12:59:15.275929753 +0000 UTC m=+609.840911503" Jun 10 12:59:26.255407 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:26.255301 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-9bnlr" Jun 10 12:59:35.178178 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:35.178148 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-24t8m" Jun 10 12:59:36.108192 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108158 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2"] Jun 10 12:59:36.108512 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108499 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="util" Jun 10 12:59:36.108588 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108514 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="util" Jun 10 12:59:36.108588 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108529 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="pull" Jun 10 12:59:36.108588 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108534 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="pull" Jun 10 12:59:36.108588 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108545 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="extract" Jun 10 12:59:36.108588 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108551 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="extract" Jun 10 12:59:36.108806 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.108611 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c6cd27d-8655-42e6-8a30-45545685771b" containerName="extract" Jun 10 12:59:36.113461 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.113438 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.115993 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.115966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 12:59:36.116111 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.115966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 12:59:36.116111 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f7flt\"" Jun 10 12:59:36.116111 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.115971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 12:59:36.116397 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:59:36.116797 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/495fa020-a702-4c3e-91c2-c14414045da9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.116855 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.116855 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ctxw\" (UniqueName: \"kubernetes.io/projected/495fa020-a702-4c3e-91c2-c14414045da9-kube-api-access-5ctxw\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.116925 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495fa020-a702-4c3e-91c2-c14414045da9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.116984 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.116964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/495fa020-a702-4c3e-91c2-c14414045da9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.117061 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.117045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.117117 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.117076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.124712 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.124689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2"] Jun 10 12:59:36.186806 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.186777 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7g9pl" Jun 10 12:59:36.217955 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.217926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218126 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.217962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218126 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.218008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/495fa020-a702-4c3e-91c2-c14414045da9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218126 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.218031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218381 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.218358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ctxw\" (UniqueName: \"kubernetes.io/projected/495fa020-a702-4c3e-91c2-c14414045da9-kube-api-access-5ctxw\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218567 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.218538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495fa020-a702-4c3e-91c2-c14414045da9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218698 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.218618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/495fa020-a702-4c3e-91c2-c14414045da9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.218954 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.218928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/495fa020-a702-4c3e-91c2-c14414045da9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.220757 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.220730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.220956 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.220936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/495fa020-a702-4c3e-91c2-c14414045da9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.221113 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.221090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.221421 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.221403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/495fa020-a702-4c3e-91c2-c14414045da9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.228985 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.228962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495fa020-a702-4c3e-91c2-c14414045da9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.229458 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.229443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ctxw\" (UniqueName: \"kubernetes.io/projected/495fa020-a702-4c3e-91c2-c14414045da9-kube-api-access-5ctxw\") pod \"istiod-openshift-gateway-75c67f8887-zdnr2\" (UID: \"495fa020-a702-4c3e-91c2-c14414045da9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.423940 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.423846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:36.567303 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.567276 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2"] Jun 10 12:59:36.569319 ip-10-0-128-84 kubenswrapper[2576]: W0610 12:59:36.569289 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495fa020_a702_4c3e_91c2_c14414045da9.slice/crio-b7fd7ee336afeabecc66ee820be7844637c4d1f4c2ff1786f494ed3ae6aed4c1 WatchSource:0}: Error finding container b7fd7ee336afeabecc66ee820be7844637c4d1f4c2ff1786f494ed3ae6aed4c1: Status 404 returned error can't find the container with id b7fd7ee336afeabecc66ee820be7844637c4d1f4c2ff1786f494ed3ae6aed4c1 Jun 10 12:59:36.571728 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:36.571710 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:59:37.358077 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:37.358043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" event={"ID":"495fa020-a702-4c3e-91c2-c14414045da9","Type":"ContainerStarted","Data":"b7fd7ee336afeabecc66ee820be7844637c4d1f4c2ff1786f494ed3ae6aed4c1"} Jun 10 12:59:40.224166 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:40.224129 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:59:40.224506 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:40.224195 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:59:40.375230 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:40.375197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" event={"ID":"495fa020-a702-4c3e-91c2-c14414045da9","Type":"ContainerStarted","Data":"7bec2de681fe4d20b4c983f0d713e15577089bb184e312871f7b8ef0b84f6e41"} Jun 10 12:59:40.375435 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:40.375267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 12:59:40.401099 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:40.401045 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" podStartSLOduration=0.748969674 podStartE2EDuration="4.401028894s" totalImagesPullingTime="3.65205922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:59:40.399302171 +0000 UTC m=+634.964283922" watchObservedRunningTime="2026-06-10 12:59:40.401028894 +0000 UTC m=+634.966010645" Jun 10 12:59:41.382032 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:41.381998 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-zdnr2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 12:59:41.382422 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:41.382054 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" podUID="495fa020-a702-4c3e-91c2-c14414045da9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:59:44.381723 ip-10-0-128-84 kubenswrapper[2576]: I0610 12:59:44.381688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zdnr2" Jun 10 13:00:05.006447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.006404 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857"] Jun 10 13:00:05.010203 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.010181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.012633 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.012613 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:00:05.012747 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.012652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:00:05.013403 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.013388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jm4pz\"" Jun 10 13:00:05.024451 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.024405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knttf\" (UniqueName: \"kubernetes.io/projected/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-kube-api-access-knttf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.024451 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.024447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857"] Jun 10 13:00:05.024620 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.024491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.024620 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.024520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.125477 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.125432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knttf\" (UniqueName: \"kubernetes.io/projected/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-kube-api-access-knttf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.125477 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.125483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.125695 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.125504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.125854 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.125833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.125894 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.125867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.138782 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.138751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knttf\" (UniqueName: \"kubernetes.io/projected/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-kube-api-access-knttf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.319249 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.319213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:05.455455 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.455428 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857"] Jun 10 13:00:05.457531 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:00:05.457506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1cb0e2_53ae_46e2_9fe6_8dcfbf6b79c7.slice/crio-58d2d6786cde4ab61c2ceb9fe9846d87be481bad1748379204bf86672ef802f3 WatchSource:0}: Error finding container 58d2d6786cde4ab61c2ceb9fe9846d87be481bad1748379204bf86672ef802f3: Status 404 returned error can't find the container with id 58d2d6786cde4ab61c2ceb9fe9846d87be481bad1748379204bf86672ef802f3 Jun 10 13:00:05.497295 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.497263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" event={"ID":"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7","Type":"ContainerStarted","Data":"58d2d6786cde4ab61c2ceb9fe9846d87be481bad1748379204bf86672ef802f3"} Jun 10 13:00:05.594496 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.594415 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq"] Jun 10 13:00:05.597885 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.597866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.606030 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.605996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq"] Jun 10 13:00:05.630559 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.630526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.630938 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.630572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.630938 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.630647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqg8f\" (UniqueName: \"kubernetes.io/projected/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-kube-api-access-hqg8f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.731511 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.731473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.731674 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.731525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.731752 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.731658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqg8f\" (UniqueName: \"kubernetes.io/projected/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-kube-api-access-hqg8f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.731882 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.731866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.731929 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.731908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.740868 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.740836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqg8f\" (UniqueName: \"kubernetes.io/projected/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-kube-api-access-hqg8f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:05.935932 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:05.935854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:06.072469 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.072295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq"] Jun 10 13:00:06.074940 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:00:06.074915 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b36a67_70d2_4f72_b7ca_5a9cc1e18234.slice/crio-eda00e59fd755fd5beec9b59520d52b95194446e13bf1776057ecd8867bfaeae WatchSource:0}: Error finding container eda00e59fd755fd5beec9b59520d52b95194446e13bf1776057ecd8867bfaeae: Status 404 returned error can't find the container with id eda00e59fd755fd5beec9b59520d52b95194446e13bf1776057ecd8867bfaeae Jun 10 13:00:06.200561 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.200470 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj"] Jun 10 13:00:06.204077 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.204051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.214430 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.214399 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj"] Jun 10 13:00:06.237230 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.237196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.237424 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.237248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l2jt\" (UniqueName: \"kubernetes.io/projected/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-kube-api-access-4l2jt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.237424 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.237269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.338239 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.338203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l2jt\" (UniqueName: \"kubernetes.io/projected/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-kube-api-access-4l2jt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.338433 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.338302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.338485 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.338439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.343864 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.339039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.343864 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.339087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.350033 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.350006 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l2jt\" (UniqueName: \"kubernetes.io/projected/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-kube-api-access-4l2jt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.503741 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.503643 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerID="5fb4d89c1cb8499b9bf6c7fc57b0125ac8d568dfc3b13b4a09bd4007abc50be9" exitCode=0 Jun 10 13:00:06.503905 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.503731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" event={"ID":"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7","Type":"ContainerDied","Data":"5fb4d89c1cb8499b9bf6c7fc57b0125ac8d568dfc3b13b4a09bd4007abc50be9"} Jun 10 13:00:06.505274 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.505248 2576 generic.go:356] "Generic (PLEG): container finished" podID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerID="f3ca50acc1325f663e09431dcf4b5ce48525780b42e692221de04a216cc2d30d" exitCode=0 Jun 10 13:00:06.505416 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.505277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" event={"ID":"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234","Type":"ContainerDied","Data":"f3ca50acc1325f663e09431dcf4b5ce48525780b42e692221de04a216cc2d30d"} Jun 10 13:00:06.505416 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.505318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" event={"ID":"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234","Type":"ContainerStarted","Data":"eda00e59fd755fd5beec9b59520d52b95194446e13bf1776057ecd8867bfaeae"} Jun 10 13:00:06.549889 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.549852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:06.615015 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.614980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6"] Jun 10 13:00:06.620660 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.620628 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.628249 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.628214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6"] Jun 10 13:00:06.642157 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.642120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.642294 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.642272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52lzb\" (UniqueName: \"kubernetes.io/projected/f9a551df-6513-4f36-b2fc-70424ab8c6a0-kube-api-access-52lzb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.642379 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.642330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.694998 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.694973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj"] Jun 10 13:00:06.696934 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:00:06.696908 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f0f2ed_40bd_43cd_98a0_61ab4e553dab.slice/crio-1ff16c9ebc4d6b01ad9331498f50ffb6fd5a06c020b5a0084574f41202494830 WatchSource:0}: Error finding container 1ff16c9ebc4d6b01ad9331498f50ffb6fd5a06c020b5a0084574f41202494830: Status 404 returned error can't find the container with id 1ff16c9ebc4d6b01ad9331498f50ffb6fd5a06c020b5a0084574f41202494830 Jun 10 13:00:06.743040 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.743009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.743247 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.743066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.743247 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.743112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52lzb\" (UniqueName: \"kubernetes.io/projected/f9a551df-6513-4f36-b2fc-70424ab8c6a0-kube-api-access-52lzb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.743469 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.743449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.743521 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.743490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.754905 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.754840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52lzb\" (UniqueName: \"kubernetes.io/projected/f9a551df-6513-4f36-b2fc-70424ab8c6a0-kube-api-access-52lzb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:06.933037 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:06.932994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:07.072363 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.072317 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6"] Jun 10 13:00:07.111184 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:00:07.111143 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a551df_6513_4f36_b2fc_70424ab8c6a0.slice/crio-4456741d2c9bf28551b0d0d08743bde9f5af7d75f0fbf5d8c5f5b2f67164fd77 WatchSource:0}: Error finding container 4456741d2c9bf28551b0d0d08743bde9f5af7d75f0fbf5d8c5f5b2f67164fd77: Status 404 returned error can't find the container with id 4456741d2c9bf28551b0d0d08743bde9f5af7d75f0fbf5d8c5f5b2f67164fd77 Jun 10 13:00:07.512641 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.512606 2576 generic.go:356] "Generic (PLEG): container finished" podID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerID="a6e47b21835688f4d7979182f1069f3b3ac722c9dea36ba7cae9c909cee213b6" exitCode=0 Jun 10 13:00:07.512817 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.512678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" event={"ID":"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234","Type":"ContainerDied","Data":"a6e47b21835688f4d7979182f1069f3b3ac722c9dea36ba7cae9c909cee213b6"} Jun 10 13:00:07.514397 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.514366 2576 generic.go:356] "Generic (PLEG): container finished" podID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerID="3484c8146b0e926248a5603ca4f050a674a8fa5609a92ff87206c54d433a20e3" exitCode=0 Jun 10 13:00:07.514397 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.514387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" event={"ID":"43f0f2ed-40bd-43cd-98a0-61ab4e553dab","Type":"ContainerDied","Data":"3484c8146b0e926248a5603ca4f050a674a8fa5609a92ff87206c54d433a20e3"} Jun 10 13:00:07.514571 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.514436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" event={"ID":"43f0f2ed-40bd-43cd-98a0-61ab4e553dab","Type":"ContainerStarted","Data":"1ff16c9ebc4d6b01ad9331498f50ffb6fd5a06c020b5a0084574f41202494830"} Jun 10 13:00:07.516096 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.516074 2576 generic.go:356] "Generic (PLEG): container finished" podID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerID="41309fbee0e19cabd98d28cfa1ab3c82bfc179bd33b8b4406b577deba3ba614f" exitCode=0 Jun 10 13:00:07.516188 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.516150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" event={"ID":"f9a551df-6513-4f36-b2fc-70424ab8c6a0","Type":"ContainerDied","Data":"41309fbee0e19cabd98d28cfa1ab3c82bfc179bd33b8b4406b577deba3ba614f"} Jun 10 13:00:07.516239 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.516197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" event={"ID":"f9a551df-6513-4f36-b2fc-70424ab8c6a0","Type":"ContainerStarted","Data":"4456741d2c9bf28551b0d0d08743bde9f5af7d75f0fbf5d8c5f5b2f67164fd77"} Jun 10 13:00:07.518125 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.518098 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerID="b483f1f9b99415aac548f0e3c99d42f8b910ecfc82f25a197b9282f6a45f5555" exitCode=0 Jun 10 13:00:07.518206 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:07.518156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" event={"ID":"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7","Type":"ContainerDied","Data":"b483f1f9b99415aac548f0e3c99d42f8b910ecfc82f25a197b9282f6a45f5555"} Jun 10 13:00:08.525380 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.525332 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerID="fef93adf19f19b13b2cd6a6987e36aa57b3fadecb30a6d113ffe676d72c89f6e" exitCode=0 Jun 10 13:00:08.525883 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.525377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" event={"ID":"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7","Type":"ContainerDied","Data":"fef93adf19f19b13b2cd6a6987e36aa57b3fadecb30a6d113ffe676d72c89f6e"} Jun 10 13:00:08.527529 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.527502 2576 generic.go:356] "Generic (PLEG): container finished" podID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerID="733e0b3220da872403be141b5f64292567e0db7275c79a66878b338c92cbc404" exitCode=0 Jun 10 13:00:08.527647 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.527576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" event={"ID":"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234","Type":"ContainerDied","Data":"733e0b3220da872403be141b5f64292567e0db7275c79a66878b338c92cbc404"} Jun 10 13:00:08.529265 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.529242 2576 generic.go:356] "Generic (PLEG): container finished" podID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerID="ff860063f0cb1aa4006914babdeaa0032f1c57f1c6223e37f050867b1390d9c6" exitCode=0 Jun 10 13:00:08.529411 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.529320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" event={"ID":"43f0f2ed-40bd-43cd-98a0-61ab4e553dab","Type":"ContainerDied","Data":"ff860063f0cb1aa4006914babdeaa0032f1c57f1c6223e37f050867b1390d9c6"} Jun 10 13:00:08.531522 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.531499 2576 generic.go:356] "Generic (PLEG): container finished" podID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerID="207ce4e50eabf790d4d0a2375ab4d5ab45690685801cb6bb34a992dd794d969c" exitCode=0 Jun 10 13:00:08.531522 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:08.531523 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" event={"ID":"f9a551df-6513-4f36-b2fc-70424ab8c6a0","Type":"ContainerDied","Data":"207ce4e50eabf790d4d0a2375ab4d5ab45690685801cb6bb34a992dd794d969c"} Jun 10 13:00:09.538569 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.538533 2576 generic.go:356] "Generic (PLEG): container finished" podID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerID="1bab8c8c5d1277dbeda44622d0639e17c3f2d346ff4c7f7bd87856bf4ffdb780" exitCode=0 Jun 10 13:00:09.539010 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.538619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" event={"ID":"43f0f2ed-40bd-43cd-98a0-61ab4e553dab","Type":"ContainerDied","Data":"1bab8c8c5d1277dbeda44622d0639e17c3f2d346ff4c7f7bd87856bf4ffdb780"} Jun 10 13:00:09.540601 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.540571 2576 generic.go:356] "Generic (PLEG): container finished" podID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerID="404949f53d5fcf8909236f26cae60af307b85ab06cea346912408e70eb6865a9" exitCode=0 Jun 10 13:00:09.540702 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.540651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" event={"ID":"f9a551df-6513-4f36-b2fc-70424ab8c6a0","Type":"ContainerDied","Data":"404949f53d5fcf8909236f26cae60af307b85ab06cea346912408e70eb6865a9"} Jun 10 13:00:09.674073 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.674045 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:09.705410 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.705386 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:09.769739 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.769703 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqg8f\" (UniqueName: \"kubernetes.io/projected/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-kube-api-access-hqg8f\") pod \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " Jun 10 13:00:09.769909 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.769756 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-bundle\") pod \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " Jun 10 13:00:09.769909 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.769800 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-bundle\") pod \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " Jun 10 13:00:09.770031 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.769949 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-util\") pod \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\" (UID: \"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234\") " Jun 10 13:00:09.770031 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.769983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knttf\" (UniqueName: \"kubernetes.io/projected/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-kube-api-access-knttf\") pod \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " Jun 10 13:00:09.770031 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.770006 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-util\") pod \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\" (UID: \"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7\") " Jun 10 13:00:09.770505 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.770475 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-bundle" (OuterVolumeSpecName: "bundle") pod "8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" (UID: "8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:09.770644 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.770614 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-bundle" (OuterVolumeSpecName: "bundle") pod "a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" (UID: "a5b36a67-70d2-4f72-b7ca-5a9cc1e18234"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:09.772172 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.772145 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-kube-api-access-hqg8f" (OuterVolumeSpecName: "kube-api-access-hqg8f") pod "a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" (UID: "a5b36a67-70d2-4f72-b7ca-5a9cc1e18234"). InnerVolumeSpecName "kube-api-access-hqg8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:00:09.772267 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.772183 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-kube-api-access-knttf" (OuterVolumeSpecName: "kube-api-access-knttf") pod "8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" (UID: "8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7"). InnerVolumeSpecName "kube-api-access-knttf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:00:09.775719 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.775695 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-util" (OuterVolumeSpecName: "util") pod "a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" (UID: "a5b36a67-70d2-4f72-b7ca-5a9cc1e18234"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:09.776024 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.776004 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-util" (OuterVolumeSpecName: "util") pod "8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" (UID: "8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:09.870988 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.870960 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqg8f\" (UniqueName: \"kubernetes.io/projected/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-kube-api-access-hqg8f\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:09.870988 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.870986 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:09.871176 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.871017 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:09.871176 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.871027 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5b36a67-70d2-4f72-b7ca-5a9cc1e18234-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:09.871176 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.871035 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knttf\" (UniqueName: \"kubernetes.io/projected/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-kube-api-access-knttf\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:09.871176 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:09.871043 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:10.547769 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.547738 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" Jun 10 13:00:10.547769 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.547753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857" event={"ID":"8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7","Type":"ContainerDied","Data":"58d2d6786cde4ab61c2ceb9fe9846d87be481bad1748379204bf86672ef802f3"} Jun 10 13:00:10.548232 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.547801 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58d2d6786cde4ab61c2ceb9fe9846d87be481bad1748379204bf86672ef802f3" Jun 10 13:00:10.549910 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.549822 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" Jun 10 13:00:10.549910 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.549863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq" event={"ID":"a5b36a67-70d2-4f72-b7ca-5a9cc1e18234","Type":"ContainerDied","Data":"eda00e59fd755fd5beec9b59520d52b95194446e13bf1776057ecd8867bfaeae"} Jun 10 13:00:10.550096 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.549942 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eda00e59fd755fd5beec9b59520d52b95194446e13bf1776057ecd8867bfaeae" Jun 10 13:00:10.708660 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.708635 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:10.710616 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.710596 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:10.779457 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.779418 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52lzb\" (UniqueName: \"kubernetes.io/projected/f9a551df-6513-4f36-b2fc-70424ab8c6a0-kube-api-access-52lzb\") pod \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " Jun 10 13:00:10.779457 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.779461 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-bundle\") pod \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " Jun 10 13:00:10.779715 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.779510 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-bundle\") pod \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " Jun 10 13:00:10.779715 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.779554 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l2jt\" (UniqueName: \"kubernetes.io/projected/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-kube-api-access-4l2jt\") pod \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " Jun 10 13:00:10.779715 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.779582 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-util\") pod \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\" (UID: \"f9a551df-6513-4f36-b2fc-70424ab8c6a0\") " Jun 10 13:00:10.779715 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.779630 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-util\") pod \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\" (UID: \"43f0f2ed-40bd-43cd-98a0-61ab4e553dab\") " Jun 10 13:00:10.780294 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.780248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-bundle" (OuterVolumeSpecName: "bundle") pod "43f0f2ed-40bd-43cd-98a0-61ab4e553dab" (UID: "43f0f2ed-40bd-43cd-98a0-61ab4e553dab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:10.780556 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.780510 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-bundle" (OuterVolumeSpecName: "bundle") pod "f9a551df-6513-4f36-b2fc-70424ab8c6a0" (UID: "f9a551df-6513-4f36-b2fc-70424ab8c6a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:10.781853 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.781824 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-kube-api-access-4l2jt" (OuterVolumeSpecName: "kube-api-access-4l2jt") pod "43f0f2ed-40bd-43cd-98a0-61ab4e553dab" (UID: "43f0f2ed-40bd-43cd-98a0-61ab4e553dab"). InnerVolumeSpecName "kube-api-access-4l2jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:00:10.781963 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.781914 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a551df-6513-4f36-b2fc-70424ab8c6a0-kube-api-access-52lzb" (OuterVolumeSpecName: "kube-api-access-52lzb") pod "f9a551df-6513-4f36-b2fc-70424ab8c6a0" (UID: "f9a551df-6513-4f36-b2fc-70424ab8c6a0"). InnerVolumeSpecName "kube-api-access-52lzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:00:10.785685 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.785656 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-util" (OuterVolumeSpecName: "util") pod "f9a551df-6513-4f36-b2fc-70424ab8c6a0" (UID: "f9a551df-6513-4f36-b2fc-70424ab8c6a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:10.786199 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.786177 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-util" (OuterVolumeSpecName: "util") pod "43f0f2ed-40bd-43cd-98a0-61ab4e553dab" (UID: "43f0f2ed-40bd-43cd-98a0-61ab4e553dab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:00:10.880670 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.880580 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52lzb\" (UniqueName: \"kubernetes.io/projected/f9a551df-6513-4f36-b2fc-70424ab8c6a0-kube-api-access-52lzb\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:10.880670 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.880612 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:10.880670 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.880623 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:10.880670 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.880631 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l2jt\" (UniqueName: \"kubernetes.io/projected/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-kube-api-access-4l2jt\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:10.880670 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.880640 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9a551df-6513-4f36-b2fc-70424ab8c6a0-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:10.880670 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:10.880649 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f0f2ed-40bd-43cd-98a0-61ab4e553dab-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:00:11.556426 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:11.556397 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" Jun 10 13:00:11.556426 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:11.556404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj" event={"ID":"43f0f2ed-40bd-43cd-98a0-61ab4e553dab","Type":"ContainerDied","Data":"1ff16c9ebc4d6b01ad9331498f50ffb6fd5a06c020b5a0084574f41202494830"} Jun 10 13:00:11.556859 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:11.556456 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ff16c9ebc4d6b01ad9331498f50ffb6fd5a06c020b5a0084574f41202494830" Jun 10 13:00:11.558205 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:11.558185 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" Jun 10 13:00:11.558316 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:11.558180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6" event={"ID":"f9a551df-6513-4f36-b2fc-70424ab8c6a0","Type":"ContainerDied","Data":"4456741d2c9bf28551b0d0d08743bde9f5af7d75f0fbf5d8c5f5b2f67164fd77"} Jun 10 13:00:11.558316 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:11.558311 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4456741d2c9bf28551b0d0d08743bde9f5af7d75f0fbf5d8c5f5b2f67164fd77" Jun 10 13:00:24.140050 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140022 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn"] Jun 10 13:00:24.140429 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140362 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="extract" Jun 10 13:00:24.140429 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140383 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="extract" Jun 10 13:00:24.140429 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140394 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="pull" Jun 10 13:00:24.140429 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140401 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="pull" Jun 10 13:00:24.140429 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140414 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="pull" Jun 10 13:00:24.140429 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140420 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="pull" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140442 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="extract" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140448 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="extract" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140465 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140475 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="extract" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140482 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="extract" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140492 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="pull" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140500 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="pull" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140515 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140524 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140533 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140542 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140549 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140560 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="util" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140568 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="extract" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140576 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="extract" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140588 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="pull" Jun 10 13:00:24.140652 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140595 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="pull" Jun 10 13:00:24.141217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140694 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7" containerName="extract" Jun 10 13:00:24.141217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140711 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a551df-6513-4f36-b2fc-70424ab8c6a0" containerName="extract" Jun 10 13:00:24.141217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140720 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f0f2ed-40bd-43cd-98a0-61ab4e553dab" containerName="extract" Jun 10 13:00:24.141217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.140729 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5b36a67-70d2-4f72-b7ca-5a9cc1e18234" containerName="extract" Jun 10 13:00:24.148122 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.148097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:24.151602 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.151578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:00:24.151722 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.151681 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:00:24.152384 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.152361 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ktsfw\"" Jun 10 13:00:24.152470 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.152384 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 13:00:24.157820 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.157797 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn"] Jun 10 13:00:24.293937 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.293901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fg2\" (UniqueName: \"kubernetes.io/projected/b87f1c57-2e27-42da-b3a0-bff692b8ce4a-kube-api-access-p7fg2\") pod \"dns-operator-controller-manager-864dd78c4c-fxhmn\" (UID: \"b87f1c57-2e27-42da-b3a0-bff692b8ce4a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:24.394801 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.394699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fg2\" (UniqueName: \"kubernetes.io/projected/b87f1c57-2e27-42da-b3a0-bff692b8ce4a-kube-api-access-p7fg2\") pod \"dns-operator-controller-manager-864dd78c4c-fxhmn\" (UID: \"b87f1c57-2e27-42da-b3a0-bff692b8ce4a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:24.411074 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.411050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fg2\" (UniqueName: \"kubernetes.io/projected/b87f1c57-2e27-42da-b3a0-bff692b8ce4a-kube-api-access-p7fg2\") pod \"dns-operator-controller-manager-864dd78c4c-fxhmn\" (UID: \"b87f1c57-2e27-42da-b3a0-bff692b8ce4a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:24.458907 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.458876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:24.610077 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.610039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn"] Jun 10 13:00:24.614402 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:00:24.614373 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87f1c57_2e27_42da_b3a0_bff692b8ce4a.slice/crio-3b30259c30639b35500f052b8cf9edbce762c44ff8077502af9c4e811fe18c75 WatchSource:0}: Error finding container 3b30259c30639b35500f052b8cf9edbce762c44ff8077502af9c4e811fe18c75: Status 404 returned error can't find the container with id 3b30259c30639b35500f052b8cf9edbce762c44ff8077502af9c4e811fe18c75 Jun 10 13:00:24.631441 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:24.631407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" event={"ID":"b87f1c57-2e27-42da-b3a0-bff692b8ce4a","Type":"ContainerStarted","Data":"3b30259c30639b35500f052b8cf9edbce762c44ff8077502af9c4e811fe18c75"} Jun 10 13:00:27.549379 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.549328 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg"] Jun 10 13:00:27.552639 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.552623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:00:27.555280 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.555258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s4d4d\"" Jun 10 13:00:27.563300 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.563278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg"] Jun 10 13:00:27.621096 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.621064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4mr\" (UniqueName: \"kubernetes.io/projected/a961c731-febd-44c1-998b-178b40c0aab0-kube-api-access-zg4mr\") pod \"authorino-operator-75cc8d5cb7-ckmxg\" (UID: \"a961c731-febd-44c1-998b-178b40c0aab0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:00:27.659887 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.659851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" event={"ID":"b87f1c57-2e27-42da-b3a0-bff692b8ce4a","Type":"ContainerStarted","Data":"6afbcde9cd2d5e1c13c71b691df8cf6c1827cb993fb133fe59f51762e9a9c669"} Jun 10 13:00:27.660016 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.659938 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:27.682681 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.682632 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" podStartSLOduration=1.5985287270000001 podStartE2EDuration="3.682616447s" totalImagesPullingTime="2.08408772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:00:27.679821089 +0000 UTC m=+682.244802845" watchObservedRunningTime="2026-06-10 13:00:27.682616447 +0000 UTC m=+682.247598197" Jun 10 13:00:27.721968 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.721928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4mr\" (UniqueName: \"kubernetes.io/projected/a961c731-febd-44c1-998b-178b40c0aab0-kube-api-access-zg4mr\") pod \"authorino-operator-75cc8d5cb7-ckmxg\" (UID: \"a961c731-febd-44c1-998b-178b40c0aab0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:00:27.733695 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.733662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4mr\" (UniqueName: \"kubernetes.io/projected/a961c731-febd-44c1-998b-178b40c0aab0-kube-api-access-zg4mr\") pod \"authorino-operator-75cc8d5cb7-ckmxg\" (UID: \"a961c731-febd-44c1-998b-178b40c0aab0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:00:27.864299 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:27.864207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:00:28.007484 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:28.007458 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg"] Jun 10 13:00:28.008752 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:00:28.008726 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda961c731_febd_44c1_998b_178b40c0aab0.slice/crio-9e2035d282fcc2a8b6aa7c8c32c5504ff87d8bdbdf7cf0598f392e833142c1b5 WatchSource:0}: Error finding container 9e2035d282fcc2a8b6aa7c8c32c5504ff87d8bdbdf7cf0598f392e833142c1b5: Status 404 returned error can't find the container with id 9e2035d282fcc2a8b6aa7c8c32c5504ff87d8bdbdf7cf0598f392e833142c1b5 Jun 10 13:00:28.667209 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:28.667171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" event={"ID":"a961c731-febd-44c1-998b-178b40c0aab0","Type":"ContainerStarted","Data":"9e2035d282fcc2a8b6aa7c8c32c5504ff87d8bdbdf7cf0598f392e833142c1b5"} Jun 10 13:00:30.679583 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:30.679549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" event={"ID":"a961c731-febd-44c1-998b-178b40c0aab0","Type":"ContainerStarted","Data":"756e7d00231db5e283584b4bbd2888b555d3e38d11640edb44942fa737d56d1d"} Jun 10 13:00:30.679943 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:30.679680 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:00:30.706297 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:30.706246 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" podStartSLOduration=1.164414418 podStartE2EDuration="3.706230168s" totalImagesPullingTime="2.54181575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:00:30.705434853 +0000 UTC m=+685.270416605" watchObservedRunningTime="2026-06-10 13:00:30.706230168 +0000 UTC m=+685.271211917" Jun 10 13:00:38.669619 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:38.669584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fxhmn" Jun 10 13:00:41.690301 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:00:41.690268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckmxg" Jun 10 13:01:14.186270 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.186231 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:01:14.191732 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.191700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.194505 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.194483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jm4pz\"" Jun 10 13:01:14.194643 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.194508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 13:01:14.203443 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.203419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:01:14.297168 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.297131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:01:14.311980 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.311941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d-config-file\") pod \"limitador-limitador-54d6d988d5-hg64k\" (UID: \"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.312137 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.312023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgtwr\" (UniqueName: \"kubernetes.io/projected/2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d-kube-api-access-dgtwr\") pod \"limitador-limitador-54d6d988d5-hg64k\" (UID: \"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.413090 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.413044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d-config-file\") pod \"limitador-limitador-54d6d988d5-hg64k\" (UID: \"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.413261 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.413126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgtwr\" (UniqueName: \"kubernetes.io/projected/2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d-kube-api-access-dgtwr\") pod \"limitador-limitador-54d6d988d5-hg64k\" (UID: \"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.413785 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.413765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d-config-file\") pod \"limitador-limitador-54d6d988d5-hg64k\" (UID: \"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.426270 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.426246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgtwr\" (UniqueName: \"kubernetes.io/projected/2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d-kube-api-access-dgtwr\") pod \"limitador-limitador-54d6d988d5-hg64k\" (UID: \"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.502886 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.502802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:14.640006 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.639979 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:01:14.641026 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:01:14.640998 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5acb9a_8bc9_4ea5_ac6d_6937f244f26d.slice/crio-e569be39f0d870702f73cf92b1cccee609c3ab721c8dbbf57e52019f941490ac WatchSource:0}: Error finding container e569be39f0d870702f73cf92b1cccee609c3ab721c8dbbf57e52019f941490ac: Status 404 returned error can't find the container with id e569be39f0d870702f73cf92b1cccee609c3ab721c8dbbf57e52019f941490ac Jun 10 13:01:14.927944 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:14.927909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" event={"ID":"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d","Type":"ContainerStarted","Data":"e569be39f0d870702f73cf92b1cccee609c3ab721c8dbbf57e52019f941490ac"} Jun 10 13:01:17.946582 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:17.946543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" event={"ID":"2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d","Type":"ContainerStarted","Data":"c205862cdccfebbbbd79383d5bb164e1adfdbd50361adb9df2ee463292c4b6ab"} Jun 10 13:01:17.947064 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:17.946675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:17.967499 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:17.967443 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" podStartSLOduration=1.4512864460000001 podStartE2EDuration="3.9674251s" totalImagesPullingTime="2.516138654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:17.966712571 +0000 UTC m=+732.531694311" watchObservedRunningTime="2026-06-10 13:01:17.9674251 +0000 UTC m=+732.532406850" Jun 10 13:01:28.953841 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:28.953811 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hg64k" Jun 10 13:01:48.183512 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.183472 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74"] Jun 10 13:01:48.188061 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.188037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.190621 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.190593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-chjxg\"" Jun 10 13:01:48.190759 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.190635 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:01:48.190759 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.190670 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:01:48.201653 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.201620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74"] Jun 10 13:01:48.207414 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.207386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.207554 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.207430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn7tb\" (UniqueName: \"kubernetes.io/projected/1edb0dbc-093d-42ce-8e0e-19268ef3583a-kube-api-access-pn7tb\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.207554 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.207498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.308198 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.308154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.308198 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.308200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn7tb\" (UniqueName: \"kubernetes.io/projected/1edb0dbc-093d-42ce-8e0e-19268ef3583a-kube-api-access-pn7tb\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.308493 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.308403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.308663 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.308629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.308742 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.308724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.322098 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.322067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn7tb\" (UniqueName: \"kubernetes.io/projected/1edb0dbc-093d-42ce-8e0e-19268ef3583a-kube-api-access-pn7tb\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.499188 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.499090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:48.650815 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:48.650789 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74"] Jun 10 13:01:48.653548 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:01:48.653520 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edb0dbc_093d_42ce_8e0e_19268ef3583a.slice/crio-efa1808a4c9ed938a896a4666b2c4e4c67230d109725a448447973061b2ea7ef WatchSource:0}: Error finding container efa1808a4c9ed938a896a4666b2c4e4c67230d109725a448447973061b2ea7ef: Status 404 returned error can't find the container with id efa1808a4c9ed938a896a4666b2c4e4c67230d109725a448447973061b2ea7ef Jun 10 13:01:49.109750 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:49.109717 2576 generic.go:356] "Generic (PLEG): container finished" podID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerID="6441c3d9a75a83292040459e1c7d26eecea83e247b9b11d1021d08a9052badac" exitCode=0 Jun 10 13:01:49.109922 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:49.109803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" event={"ID":"1edb0dbc-093d-42ce-8e0e-19268ef3583a","Type":"ContainerDied","Data":"6441c3d9a75a83292040459e1c7d26eecea83e247b9b11d1021d08a9052badac"} Jun 10 13:01:49.109922 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:49.109858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" event={"ID":"1edb0dbc-093d-42ce-8e0e-19268ef3583a","Type":"ContainerStarted","Data":"efa1808a4c9ed938a896a4666b2c4e4c67230d109725a448447973061b2ea7ef"} Jun 10 13:01:50.117496 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:50.117456 2576 generic.go:356] "Generic (PLEG): container finished" podID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerID="1ac375401932391918ab32edb43e207b84a416d154f9c3902009bcce998ae92b" exitCode=0 Jun 10 13:01:50.117885 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:50.117505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" event={"ID":"1edb0dbc-093d-42ce-8e0e-19268ef3583a","Type":"ContainerDied","Data":"1ac375401932391918ab32edb43e207b84a416d154f9c3902009bcce998ae92b"} Jun 10 13:01:51.125312 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:51.125272 2576 generic.go:356] "Generic (PLEG): container finished" podID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerID="7fb33e2e33b6ce3fadf57590ed627a4942c483e12b5d38f9d588472a3eabf695" exitCode=0 Jun 10 13:01:51.125789 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:51.125367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" event={"ID":"1edb0dbc-093d-42ce-8e0e-19268ef3583a","Type":"ContainerDied","Data":"7fb33e2e33b6ce3fadf57590ed627a4942c483e12b5d38f9d588472a3eabf695"} Jun 10 13:01:52.273092 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.273064 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:52.336570 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.336543 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-util\") pod \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " Jun 10 13:01:52.336768 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.336581 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn7tb\" (UniqueName: \"kubernetes.io/projected/1edb0dbc-093d-42ce-8e0e-19268ef3583a-kube-api-access-pn7tb\") pod \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " Jun 10 13:01:52.336768 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.336674 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-bundle\") pod \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\" (UID: \"1edb0dbc-093d-42ce-8e0e-19268ef3583a\") " Jun 10 13:01:52.337173 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.337140 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-bundle" (OuterVolumeSpecName: "bundle") pod "1edb0dbc-093d-42ce-8e0e-19268ef3583a" (UID: "1edb0dbc-093d-42ce-8e0e-19268ef3583a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:01:52.338746 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.338723 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1edb0dbc-093d-42ce-8e0e-19268ef3583a-kube-api-access-pn7tb" (OuterVolumeSpecName: "kube-api-access-pn7tb") pod "1edb0dbc-093d-42ce-8e0e-19268ef3583a" (UID: "1edb0dbc-093d-42ce-8e0e-19268ef3583a"). InnerVolumeSpecName "kube-api-access-pn7tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:01:52.344505 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.344477 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-util" (OuterVolumeSpecName: "util") pod "1edb0dbc-093d-42ce-8e0e-19268ef3583a" (UID: "1edb0dbc-093d-42ce-8e0e-19268ef3583a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:01:52.437623 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.437538 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-bundle\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:01:52.437623 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.437567 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1edb0dbc-093d-42ce-8e0e-19268ef3583a-util\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:01:52.437623 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:52.437576 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn7tb\" (UniqueName: \"kubernetes.io/projected/1edb0dbc-093d-42ce-8e0e-19268ef3583a-kube-api-access-pn7tb\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:01:53.144841 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:53.144814 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" Jun 10 13:01:53.144998 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:53.144814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748d7q74" event={"ID":"1edb0dbc-093d-42ce-8e0e-19268ef3583a","Type":"ContainerDied","Data":"efa1808a4c9ed938a896a4666b2c4e4c67230d109725a448447973061b2ea7ef"} Jun 10 13:01:53.144998 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:01:53.144952 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efa1808a4c9ed938a896a4666b2c4e4c67230d109725a448447973061b2ea7ef" Jun 10 13:02:47.524145 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524110 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765bdd6484-cxdjh"] Jun 10 13:02:47.524607 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524514 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="pull" Jun 10 13:02:47.524607 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524527 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="pull" Jun 10 13:02:47.524607 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524536 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="extract" Jun 10 13:02:47.524607 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524542 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="extract" Jun 10 13:02:47.524607 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524552 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="util" Jun 10 13:02:47.524607 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524557 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="util" Jun 10 13:02:47.524791 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.524646 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1edb0dbc-093d-42ce-8e0e-19268ef3583a" containerName="extract" Jun 10 13:02:47.527414 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.527394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:47.529938 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.529911 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:02:47.530071 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.530029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:02:47.530162 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.530142 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wbfdv\"" Jun 10 13:02:47.538746 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.538719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765bdd6484-cxdjh"] Jun 10 13:02:47.613195 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.613163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfl45\" (UniqueName: \"kubernetes.io/projected/7ee25e5d-8114-4a2f-b08e-fa62e494b086-kube-api-access-mfl45\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:47.613402 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.613223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:47.700515 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.700477 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b697cffb7-57ffj"] Jun 10 13:02:47.703431 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.703410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:47.714530 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.714505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d06fdc-1bde-46c9-b16b-7395f6e5f555-webhook-cert\") pod \"maas-controller-b697cffb7-57ffj\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:47.714651 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.714552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:47.714651 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.714595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfl45\" (UniqueName: \"kubernetes.io/projected/7ee25e5d-8114-4a2f-b08e-fa62e494b086-kube-api-access-mfl45\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:47.714651 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.714629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgg76\" (UniqueName: \"kubernetes.io/projected/49d06fdc-1bde-46c9-b16b-7395f6e5f555-kube-api-access-pgg76\") pod \"maas-controller-b697cffb7-57ffj\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:47.714814 ip-10-0-128-84 kubenswrapper[2576]: E0610 13:02:47.714704 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 13:02:47.714814 ip-10-0-128-84 kubenswrapper[2576]: E0610 13:02:47.714772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert podName:7ee25e5d-8114-4a2f-b08e-fa62e494b086 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:48.214753292 +0000 UTC m=+822.779735024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert") pod "maas-controller-765bdd6484-cxdjh" (UID: "7ee25e5d-8114-4a2f-b08e-fa62e494b086") : secret "maas-controller-webhook-cert" not found Jun 10 13:02:47.715019 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.715001 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b697cffb7-57ffj"] Jun 10 13:02:47.729471 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.729437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfl45\" (UniqueName: \"kubernetes.io/projected/7ee25e5d-8114-4a2f-b08e-fa62e494b086-kube-api-access-mfl45\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:47.815579 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.815543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d06fdc-1bde-46c9-b16b-7395f6e5f555-webhook-cert\") pod \"maas-controller-b697cffb7-57ffj\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:47.815768 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.815668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgg76\" (UniqueName: \"kubernetes.io/projected/49d06fdc-1bde-46c9-b16b-7395f6e5f555-kube-api-access-pgg76\") pod \"maas-controller-b697cffb7-57ffj\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:47.817941 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.817920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d06fdc-1bde-46c9-b16b-7395f6e5f555-webhook-cert\") pod \"maas-controller-b697cffb7-57ffj\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:47.825221 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:47.825193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgg76\" (UniqueName: \"kubernetes.io/projected/49d06fdc-1bde-46c9-b16b-7395f6e5f555-kube-api-access-pgg76\") pod \"maas-controller-b697cffb7-57ffj\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:48.013729 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.013689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:48.159217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.159189 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b697cffb7-57ffj"] Jun 10 13:02:48.161149 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:02:48.161117 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d06fdc_1bde_46c9_b16b_7395f6e5f555.slice/crio-835728872a7cb497d5f82fd42349c5bc81fe20f4c8659718ab0518ece824a67d WatchSource:0}: Error finding container 835728872a7cb497d5f82fd42349c5bc81fe20f4c8659718ab0518ece824a67d: Status 404 returned error can't find the container with id 835728872a7cb497d5f82fd42349c5bc81fe20f4c8659718ab0518ece824a67d Jun 10 13:02:48.219517 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.219483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:48.221870 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.221841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert\") pod \"maas-controller-765bdd6484-cxdjh\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:48.438572 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.438464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:48.451077 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.451046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b697cffb7-57ffj" event={"ID":"49d06fdc-1bde-46c9-b16b-7395f6e5f555","Type":"ContainerStarted","Data":"835728872a7cb497d5f82fd42349c5bc81fe20f4c8659718ab0518ece824a67d"} Jun 10 13:02:48.587745 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:48.587718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765bdd6484-cxdjh"] Jun 10 13:02:48.588962 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:02:48.588939 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee25e5d_8114_4a2f_b08e_fa62e494b086.slice/crio-c2c5a22350c327ba5d14507359799277f2b097b02ccf1b06ae17e29cb8445647 WatchSource:0}: Error finding container c2c5a22350c327ba5d14507359799277f2b097b02ccf1b06ae17e29cb8445647: Status 404 returned error can't find the container with id c2c5a22350c327ba5d14507359799277f2b097b02ccf1b06ae17e29cb8445647 Jun 10 13:02:49.461813 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:49.461763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765bdd6484-cxdjh" event={"ID":"7ee25e5d-8114-4a2f-b08e-fa62e494b086","Type":"ContainerStarted","Data":"c2c5a22350c327ba5d14507359799277f2b097b02ccf1b06ae17e29cb8445647"} Jun 10 13:02:51.475926 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:51.475887 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b697cffb7-57ffj" event={"ID":"49d06fdc-1bde-46c9-b16b-7395f6e5f555","Type":"ContainerStarted","Data":"01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a"} Jun 10 13:02:51.476437 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:51.475963 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:02:51.477502 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:51.477471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765bdd6484-cxdjh" event={"ID":"7ee25e5d-8114-4a2f-b08e-fa62e494b086","Type":"ContainerStarted","Data":"a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57"} Jun 10 13:02:51.477628 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:51.477523 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:02:51.509734 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:51.509682 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b697cffb7-57ffj" podStartSLOduration=1.675659126 podStartE2EDuration="4.509665381s" totalImagesPullingTime="2.834006255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:51.503473747 +0000 UTC m=+826.068455497" watchObservedRunningTime="2026-06-10 13:02:51.509665381 +0000 UTC m=+826.074647152" Jun 10 13:02:51.565277 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:02:51.565224 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-765bdd6484-cxdjh" podStartSLOduration=2.152527002 podStartE2EDuration="4.565206744s" totalImagesPullingTime="2.412679742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:51.541774838 +0000 UTC m=+826.106756588" watchObservedRunningTime="2026-06-10 13:02:51.565206744 +0000 UTC m=+826.130188495" Jun 10 13:03:02.492479 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.492447 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:03:02.492947 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.492739 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:03:02.589891 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.589856 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765bdd6484-cxdjh"] Jun 10 13:03:02.590072 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.590034 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-765bdd6484-cxdjh" podUID="7ee25e5d-8114-4a2f-b08e-fa62e494b086" containerName="manager" containerID="cri-o://a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57" gracePeriod=30 Jun 10 13:03:02.843293 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.843266 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:03:02.955634 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.955595 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert\") pod \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " Jun 10 13:03:02.955810 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.955668 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfl45\" (UniqueName: \"kubernetes.io/projected/7ee25e5d-8114-4a2f-b08e-fa62e494b086-kube-api-access-mfl45\") pod \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\" (UID: \"7ee25e5d-8114-4a2f-b08e-fa62e494b086\") " Jun 10 13:03:02.957885 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.957858 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7ee25e5d-8114-4a2f-b08e-fa62e494b086" (UID: "7ee25e5d-8114-4a2f-b08e-fa62e494b086"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:03:02.957994 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:02.957976 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee25e5d-8114-4a2f-b08e-fa62e494b086-kube-api-access-mfl45" (OuterVolumeSpecName: "kube-api-access-mfl45") pod "7ee25e5d-8114-4a2f-b08e-fa62e494b086" (UID: "7ee25e5d-8114-4a2f-b08e-fa62e494b086"). InnerVolumeSpecName "kube-api-access-mfl45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:03:03.056977 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.056940 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ee25e5d-8114-4a2f-b08e-fa62e494b086-webhook-cert\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:03:03.056977 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.056973 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfl45\" (UniqueName: \"kubernetes.io/projected/7ee25e5d-8114-4a2f-b08e-fa62e494b086-kube-api-access-mfl45\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:03:03.553392 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.553326 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ee25e5d-8114-4a2f-b08e-fa62e494b086" containerID="a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57" exitCode=0 Jun 10 13:03:03.553392 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.553373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765bdd6484-cxdjh" event={"ID":"7ee25e5d-8114-4a2f-b08e-fa62e494b086","Type":"ContainerDied","Data":"a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57"} Jun 10 13:03:03.553392 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.553396 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765bdd6484-cxdjh" Jun 10 13:03:03.553958 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.553436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765bdd6484-cxdjh" event={"ID":"7ee25e5d-8114-4a2f-b08e-fa62e494b086","Type":"ContainerDied","Data":"c2c5a22350c327ba5d14507359799277f2b097b02ccf1b06ae17e29cb8445647"} Jun 10 13:03:03.553958 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.553483 2576 scope.go:117] "RemoveContainer" containerID="a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57" Jun 10 13:03:03.562935 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.562914 2576 scope.go:117] "RemoveContainer" containerID="a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57" Jun 10 13:03:03.563191 ip-10-0-128-84 kubenswrapper[2576]: E0610 13:03:03.563168 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57\": container with ID starting with a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57 not found: ID does not exist" containerID="a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57" Jun 10 13:03:03.563257 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.563204 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57"} err="failed to get container status \"a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57\": rpc error: code = NotFound desc = could not find container \"a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57\": container with ID starting with a9daf7b65bfaf3ded9ffd0d23dada89636e4851c9a51751448a388e92e548a57 not found: ID does not exist" Jun 10 13:03:03.594050 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.594011 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765bdd6484-cxdjh"] Jun 10 13:03:03.598546 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.598519 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-765bdd6484-cxdjh"] Jun 10 13:03:03.946664 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:03.946589 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ee25e5d-8114-4a2f-b08e-fa62e494b086" path="/var/lib/kubelet/pods/7ee25e5d-8114-4a2f-b08e-fa62e494b086/volumes" Jun 10 13:03:20.946290 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.946252 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:03:20.960544 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.960519 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-svm5f"] Jun 10 13:03:20.960859 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.960847 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee25e5d-8114-4a2f-b08e-fa62e494b086" containerName="manager" Jun 10 13:03:20.960906 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.960861 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee25e5d-8114-4a2f-b08e-fa62e494b086" containerName="manager" Jun 10 13:03:20.960940 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.960928 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee25e5d-8114-4a2f-b08e-fa62e494b086" containerName="manager" Jun 10 13:03:20.965422 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.965398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:03:20.968211 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.968179 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 13:03:20.968474 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.968460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jtf8j\"" Jun 10 13:03:20.974524 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:20.974498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-svm5f"] Jun 10 13:03:21.110724 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:21.110682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrxgl\" (UniqueName: \"kubernetes.io/projected/9852d44a-9d27-4261-9155-1e6e46e680ef-kube-api-access-zrxgl\") pod \"payload-processing-699b6cd6c-svm5f\" (UID: \"9852d44a-9d27-4261-9155-1e6e46e680ef\") " pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:03:21.211153 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:21.211057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrxgl\" (UniqueName: \"kubernetes.io/projected/9852d44a-9d27-4261-9155-1e6e46e680ef-kube-api-access-zrxgl\") pod \"payload-processing-699b6cd6c-svm5f\" (UID: \"9852d44a-9d27-4261-9155-1e6e46e680ef\") " pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:03:21.222805 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:21.222775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrxgl\" (UniqueName: \"kubernetes.io/projected/9852d44a-9d27-4261-9155-1e6e46e680ef-kube-api-access-zrxgl\") pod \"payload-processing-699b6cd6c-svm5f\" (UID: \"9852d44a-9d27-4261-9155-1e6e46e680ef\") " pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:03:21.280403 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:21.280316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:03:21.438806 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:21.438775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-svm5f"] Jun 10 13:03:21.440001 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:03:21.439974 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9852d44a_9d27_4261_9155_1e6e46e680ef.slice/crio-faddb96ff1adcf01d0647076326c1547f619b8d3d67e187b8a70156eb9b30269 WatchSource:0}: Error finding container faddb96ff1adcf01d0647076326c1547f619b8d3d67e187b8a70156eb9b30269: Status 404 returned error can't find the container with id faddb96ff1adcf01d0647076326c1547f619b8d3d67e187b8a70156eb9b30269 Jun 10 13:03:21.654271 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:21.654232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" event={"ID":"9852d44a-9d27-4261-9155-1e6e46e680ef","Type":"ContainerStarted","Data":"faddb96ff1adcf01d0647076326c1547f619b8d3d67e187b8a70156eb9b30269"} Jun 10 13:03:23.668249 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:23.668211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" event={"ID":"9852d44a-9d27-4261-9155-1e6e46e680ef","Type":"ContainerStarted","Data":"bb988a0282fc34d8bb5231dd5dde2079292f276515b19bcce858b25304afb6d7"} Jun 10 13:03:23.668683 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:23.668381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:03:23.686825 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:23.686765 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" podStartSLOduration=1.5492050000000002 podStartE2EDuration="3.686748105s" totalImagesPullingTime="2.137543105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:23.685327124 +0000 UTC m=+858.250308873" watchObservedRunningTime="2026-06-10 13:03:23.686748105 +0000 UTC m=+858.251729855" Jun 10 13:03:34.676402 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:03:34.676341 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-svm5f" Jun 10 13:04:05.958059 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:05.958025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:04:05.958883 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:05.958862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:04:28.234704 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:28.234660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:04:45.422426 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:45.422382 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:04:53.382418 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.382381 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5"] Jun 10 13:04:53.386657 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.386634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.389360 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.389315 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:04:53.389998 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.389977 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 13:04:53.390108 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.390031 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p9frf\"" Jun 10 13:04:53.390108 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.390068 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:04:53.400025 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.400000 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5"] Jun 10 13:04:53.479011 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.478970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.479011 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.479016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.479227 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.479070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.479227 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.479089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.479227 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.479145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae659688-af51-478d-bd4f-0a6c29bd5b84-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.479227 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.479173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs58w\" (UniqueName: \"kubernetes.io/projected/ae659688-af51-478d-bd4f-0a6c29bd5b84-kube-api-access-qs58w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580218 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580218 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580487 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae659688-af51-478d-bd4f-0a6c29bd5b84-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580487 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs58w\" (UniqueName: \"kubernetes.io/projected/ae659688-af51-478d-bd4f-0a6c29bd5b84-kube-api-access-qs58w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580487 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580487 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580681 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580681 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.580793 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.580730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.582692 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.582665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae659688-af51-478d-bd4f-0a6c29bd5b84-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.582903 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.582886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae659688-af51-478d-bd4f-0a6c29bd5b84-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.590419 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.590395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs58w\" (UniqueName: \"kubernetes.io/projected/ae659688-af51-478d-bd4f-0a6c29bd5b84-kube-api-access-qs58w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5\" (UID: \"ae659688-af51-478d-bd4f-0a6c29bd5b84\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.698379 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.698260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:04:53.841009 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.840983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5"] Jun 10 13:04:53.842607 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:04:53.842579 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae659688_af51_478d_bd4f_0a6c29bd5b84.slice/crio-5b94bc272ba770505a95d1601859eef3cd8876c0516abced47b61f40c95d8e23 WatchSource:0}: Error finding container 5b94bc272ba770505a95d1601859eef3cd8876c0516abced47b61f40c95d8e23: Status 404 returned error can't find the container with id 5b94bc272ba770505a95d1601859eef3cd8876c0516abced47b61f40c95d8e23 Jun 10 13:04:53.844600 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.844578 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:04:53.909193 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:53.909151 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:04:54.168933 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:54.168899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" event={"ID":"ae659688-af51-478d-bd4f-0a6c29bd5b84","Type":"ContainerStarted","Data":"5b94bc272ba770505a95d1601859eef3cd8876c0516abced47b61f40c95d8e23"} Jun 10 13:04:58.193595 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:04:58.193558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" event={"ID":"ae659688-af51-478d-bd4f-0a6c29bd5b84","Type":"ContainerStarted","Data":"8a6ea80bf696574bdb8afb6061f992424c6543a20ce1acc5d8f810c6685cefcf"} Jun 10 13:05:15.506023 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:15.505984 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:05:34.790756 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.790541 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl"] Jun 10 13:05:34.806873 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.806842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:34.807756 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.807725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl"] Jun 10 13:05:34.809322 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.809298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 13:05:34.954390 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.954308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:34.954390 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.954384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952d5f53-6096-4834-8a57-984aa4ee5962-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:34.954619 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.954408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:34.954619 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.954430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:34.954619 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.954449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc9pw\" (UniqueName: \"kubernetes.io/projected/952d5f53-6096-4834-8a57-984aa4ee5962-kube-api-access-mc9pw\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:34.954619 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:34.954558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.055955 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.055925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056138 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.055960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952d5f53-6096-4834-8a57-984aa4ee5962-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056138 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.055983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056138 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.056005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056138 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.056025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc9pw\" (UniqueName: \"kubernetes.io/projected/952d5f53-6096-4834-8a57-984aa4ee5962-kube-api-access-mc9pw\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056138 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.056055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056471 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.056440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056649 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.056622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.056757 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.056662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.058432 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.058414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952d5f53-6096-4834-8a57-984aa4ee5962-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.058721 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.058704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952d5f53-6096-4834-8a57-984aa4ee5962-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.069846 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.069816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc9pw\" (UniqueName: \"kubernetes.io/projected/952d5f53-6096-4834-8a57-984aa4ee5962-kube-api-access-mc9pw\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rghtl\" (UID: \"952d5f53-6096-4834-8a57-984aa4ee5962\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.120404 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.120334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:05:35.226408 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.226371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:05:35.276505 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.276478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl"] Jun 10 13:05:35.278464 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:05:35.278437 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952d5f53_6096_4834_8a57_984aa4ee5962.slice/crio-2d8cba216673fa199158353d554f5852268d7a4b3561d48ac21e0fa21a657dbf WatchSource:0}: Error finding container 2d8cba216673fa199158353d554f5852268d7a4b3561d48ac21e0fa21a657dbf: Status 404 returned error can't find the container with id 2d8cba216673fa199158353d554f5852268d7a4b3561d48ac21e0fa21a657dbf Jun 10 13:05:35.408143 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.408109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" event={"ID":"952d5f53-6096-4834-8a57-984aa4ee5962","Type":"ContainerStarted","Data":"55b62817ec196d20378af8c46d146050d384f11f52ffd3e2bcb3a9b59dc0a53a"} Jun 10 13:05:35.408312 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:35.408164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" event={"ID":"952d5f53-6096-4834-8a57-984aa4ee5962","Type":"ContainerStarted","Data":"2d8cba216673fa199158353d554f5852268d7a4b3561d48ac21e0fa21a657dbf"} Jun 10 13:05:53.508964 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:53.508931 2576 generic.go:356] "Generic (PLEG): container finished" podID="ae659688-af51-478d-bd4f-0a6c29bd5b84" containerID="8a6ea80bf696574bdb8afb6061f992424c6543a20ce1acc5d8f810c6685cefcf" exitCode=0 Jun 10 13:05:53.509412 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:53.509011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" event={"ID":"ae659688-af51-478d-bd4f-0a6c29bd5b84","Type":"ContainerDied","Data":"8a6ea80bf696574bdb8afb6061f992424c6543a20ce1acc5d8f810c6685cefcf"} Jun 10 13:05:55.523643 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:55.523603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" event={"ID":"ae659688-af51-478d-bd4f-0a6c29bd5b84","Type":"ContainerStarted","Data":"6bf2ccefd9e418c6033a934a0aa195b7e6d1eb7f741f850ce7da50a0a8ad3627"} Jun 10 13:05:55.547206 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:05:55.547142 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" podStartSLOduration=2.360001477 podStartE2EDuration="1m2.547123658s" totalImagesPullingTime="5.12095456s" totalInitContainerRuntime="55.066167621s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:55.54609206 +0000 UTC m=+1010.111073835" watchObservedRunningTime="2026-06-10 13:05:55.547123658 +0000 UTC m=+1010.112105408" Jun 10 13:06:01.117303 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:01.117266 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:06:03.699399 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:03.699327 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:06:03.699819 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:03.699427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:06:03.711910 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:03.711881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:06:04.587304 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:04.587276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5" Jun 10 13:06:28.716917 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:28.716825 2576 generic.go:356] "Generic (PLEG): container finished" podID="952d5f53-6096-4834-8a57-984aa4ee5962" containerID="55b62817ec196d20378af8c46d146050d384f11f52ffd3e2bcb3a9b59dc0a53a" exitCode=0 Jun 10 13:06:28.716917 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:28.716891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" event={"ID":"952d5f53-6096-4834-8a57-984aa4ee5962","Type":"ContainerDied","Data":"55b62817ec196d20378af8c46d146050d384f11f52ffd3e2bcb3a9b59dc0a53a"} Jun 10 13:06:29.726795 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:29.726762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" event={"ID":"952d5f53-6096-4834-8a57-984aa4ee5962","Type":"ContainerStarted","Data":"cfc19afa7f8882178ddb018549ef0ce41ee671fd45c4b558c316c27b38c021ec"} Jun 10 13:06:29.757321 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:29.757267 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" podStartSLOduration=2.436442114 podStartE2EDuration="55.757249815s" totalImagesPullingTime="301.898073ms" totalInitContainerRuntime="53.018909628s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:29.755010679 +0000 UTC m=+1044.319992430" watchObservedRunningTime="2026-06-10 13:06:29.757249815 +0000 UTC m=+1044.322231566" Jun 10 13:06:35.120701 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:35.120663 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:06:35.121096 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:35.120734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:06:35.133657 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:35.133632 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:06:35.772706 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:06:35.772678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rghtl" Jun 10 13:08:07.410018 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:08:07.409983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:08:17.109186 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:08:17.109150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:08:26.061179 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:08:26.061082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:08:36.534593 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:08:36.534551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:08:46.016367 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:08:46.016317 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:08:56.424065 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:08:56.424027 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:09:03.947103 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:03.947069 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b697cffb7-57ffj"] Jun 10 13:09:03.947668 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:03.947246 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-b697cffb7-57ffj" podUID="49d06fdc-1bde-46c9-b16b-7395f6e5f555" containerName="manager" containerID="cri-o://01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a" gracePeriod=30 Jun 10 13:09:04.196786 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.196761 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:09:04.270673 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.270581 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgg76\" (UniqueName: \"kubernetes.io/projected/49d06fdc-1bde-46c9-b16b-7395f6e5f555-kube-api-access-pgg76\") pod \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " Jun 10 13:09:04.270673 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.270650 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d06fdc-1bde-46c9-b16b-7395f6e5f555-webhook-cert\") pod \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\" (UID: \"49d06fdc-1bde-46c9-b16b-7395f6e5f555\") " Jun 10 13:09:04.272676 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.272643 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d06fdc-1bde-46c9-b16b-7395f6e5f555-kube-api-access-pgg76" (OuterVolumeSpecName: "kube-api-access-pgg76") pod "49d06fdc-1bde-46c9-b16b-7395f6e5f555" (UID: "49d06fdc-1bde-46c9-b16b-7395f6e5f555"). InnerVolumeSpecName "kube-api-access-pgg76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:04.272792 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.272672 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d06fdc-1bde-46c9-b16b-7395f6e5f555-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "49d06fdc-1bde-46c9-b16b-7395f6e5f555" (UID: "49d06fdc-1bde-46c9-b16b-7395f6e5f555"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:09:04.371521 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.371488 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d06fdc-1bde-46c9-b16b-7395f6e5f555-webhook-cert\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:09:04.371521 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.371515 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgg76\" (UniqueName: \"kubernetes.io/projected/49d06fdc-1bde-46c9-b16b-7395f6e5f555-kube-api-access-pgg76\") on node \"ip-10-0-128-84.ec2.internal\" DevicePath \"\"" Jun 10 13:09:04.619203 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.619168 2576 generic.go:356] "Generic (PLEG): container finished" podID="49d06fdc-1bde-46c9-b16b-7395f6e5f555" containerID="01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a" exitCode=0 Jun 10 13:09:04.619413 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.619215 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b697cffb7-57ffj" Jun 10 13:09:04.619413 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.619263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b697cffb7-57ffj" event={"ID":"49d06fdc-1bde-46c9-b16b-7395f6e5f555","Type":"ContainerDied","Data":"01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a"} Jun 10 13:09:04.619413 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.619313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b697cffb7-57ffj" event={"ID":"49d06fdc-1bde-46c9-b16b-7395f6e5f555","Type":"ContainerDied","Data":"835728872a7cb497d5f82fd42349c5bc81fe20f4c8659718ab0518ece824a67d"} Jun 10 13:09:04.619413 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.619341 2576 scope.go:117] "RemoveContainer" containerID="01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a" Jun 10 13:09:04.629148 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.629132 2576 scope.go:117] "RemoveContainer" containerID="01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a" Jun 10 13:09:04.629431 ip-10-0-128-84 kubenswrapper[2576]: E0610 13:09:04.629413 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a\": container with ID starting with 01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a not found: ID does not exist" containerID="01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a" Jun 10 13:09:04.629475 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.629439 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a"} err="failed to get container status \"01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a\": rpc error: code = NotFound desc = could not find container \"01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a\": container with ID starting with 01c046626589f4c3c9800f4e84be56da4008a531ff4ba7683bd11c2a9d563d7a not found: ID does not exist" Jun 10 13:09:04.645954 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.645925 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b697cffb7-57ffj"] Jun 10 13:09:04.650685 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:04.650663 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b697cffb7-57ffj"] Jun 10 13:09:05.404461 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.404421 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b697cffb7-fpg8b"] Jun 10 13:09:05.405023 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.405000 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d06fdc-1bde-46c9-b16b-7395f6e5f555" containerName="manager" Jun 10 13:09:05.405112 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.405025 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d06fdc-1bde-46c9-b16b-7395f6e5f555" containerName="manager" Jun 10 13:09:05.405168 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.405153 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d06fdc-1bde-46c9-b16b-7395f6e5f555" containerName="manager" Jun 10 13:09:05.409479 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.409457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.412023 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.411998 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:09:05.412847 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.412829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:09:05.412941 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.412847 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wbfdv\"" Jun 10 13:09:05.418694 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.418669 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b697cffb7-fpg8b"] Jun 10 13:09:05.582326 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.582290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg8cj\" (UniqueName: \"kubernetes.io/projected/c92ef33b-244e-4f8e-b2af-b2a2d3cc5395-kube-api-access-zg8cj\") pod \"maas-controller-b697cffb7-fpg8b\" (UID: \"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395\") " pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.582523 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.582399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c92ef33b-244e-4f8e-b2af-b2a2d3cc5395-webhook-cert\") pod \"maas-controller-b697cffb7-fpg8b\" (UID: \"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395\") " pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.683190 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.683099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg8cj\" (UniqueName: \"kubernetes.io/projected/c92ef33b-244e-4f8e-b2af-b2a2d3cc5395-kube-api-access-zg8cj\") pod \"maas-controller-b697cffb7-fpg8b\" (UID: \"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395\") " pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.683190 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.683166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c92ef33b-244e-4f8e-b2af-b2a2d3cc5395-webhook-cert\") pod \"maas-controller-b697cffb7-fpg8b\" (UID: \"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395\") " pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.685706 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.685673 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c92ef33b-244e-4f8e-b2af-b2a2d3cc5395-webhook-cert\") pod \"maas-controller-b697cffb7-fpg8b\" (UID: \"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395\") " pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.693774 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.693750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg8cj\" (UniqueName: \"kubernetes.io/projected/c92ef33b-244e-4f8e-b2af-b2a2d3cc5395-kube-api-access-zg8cj\") pod \"maas-controller-b697cffb7-fpg8b\" (UID: \"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395\") " pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.721237 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.721204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:05.860760 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.860737 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b697cffb7-fpg8b"] Jun 10 13:09:05.862489 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:09:05.862461 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92ef33b_244e_4f8e_b2af_b2a2d3cc5395.slice/crio-d333a663d3fc20af70ba84ab36ad1f3018b9f116a08408fe33667f3a2157a5fb WatchSource:0}: Error finding container d333a663d3fc20af70ba84ab36ad1f3018b9f116a08408fe33667f3a2157a5fb: Status 404 returned error can't find the container with id d333a663d3fc20af70ba84ab36ad1f3018b9f116a08408fe33667f3a2157a5fb Jun 10 13:09:05.946967 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.946886 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d06fdc-1bde-46c9-b16b-7395f6e5f555" path="/var/lib/kubelet/pods/49d06fdc-1bde-46c9-b16b-7395f6e5f555/volumes" Jun 10 13:09:05.994824 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.994787 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:09:05.998613 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:05.998589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:09:06.339924 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:06.339902 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:09:06.633795 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:06.633689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b697cffb7-fpg8b" event={"ID":"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395","Type":"ContainerStarted","Data":"7ef5a852315ba868678298ea63218861b7c57c273d925e2c3b798c678bc02aca"} Jun 10 13:09:06.633795 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:06.633749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b697cffb7-fpg8b" event={"ID":"c92ef33b-244e-4f8e-b2af-b2a2d3cc5395","Type":"ContainerStarted","Data":"d333a663d3fc20af70ba84ab36ad1f3018b9f116a08408fe33667f3a2157a5fb"} Jun 10 13:09:06.634228 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:06.633833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:06.653905 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:06.653854 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b697cffb7-fpg8b" podStartSLOduration=1.180527225 podStartE2EDuration="1.653838485s" totalImagesPullingTime="473.31126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:06.651577691 +0000 UTC m=+1201.216559462" watchObservedRunningTime="2026-06-10 13:09:06.653838485 +0000 UTC m=+1201.218820235" Jun 10 13:09:17.646043 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:17.646011 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b697cffb7-fpg8b" Jun 10 13:09:28.510730 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:28.510693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:09:32.600498 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:32.600456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:09:39.400946 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:39.400905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:09:41.910290 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:09:41.910253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:10:11.401682 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:10:11.401596 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:10:27.910715 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:10:27.910682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:11:06.804291 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:11:06.804256 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:11:24.027073 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:11:24.026990 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:11:39.023702 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:11:39.023664 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:11:55.311260 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:11:55.311224 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:12:21.222991 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:12:21.222946 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:12:24.724954 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:12:24.724918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:12:39.511017 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:12:39.510982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:12:42.421722 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:12:42.421683 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:13:04.714544 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:13:04.714462 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:13:14.126485 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:13:14.126447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:13:30.514158 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:13:30.514124 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:13:39.303848 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:13:39.303809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:13:56.021389 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:13:56.021341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:14:04.439527 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:04.439485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:14:06.038134 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:06.038105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:14:06.043535 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:06.043513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:14:37.013759 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:37.013720 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:14:46.108974 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:46.108940 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:14:47.265596 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:47.265559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:14:53.906705 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:14:53.906668 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:15:02.308661 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:15:02.308618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:15:10.711032 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:15:10.710997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:15:19.016843 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:15:19.016808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:15:21.808984 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:15:21.808948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:15:28.003903 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:15:28.003870 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:15:39.109820 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:15:39.109783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:17.712770 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:17.712681 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:19.810714 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:19.810677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:28.206224 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:28.206183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:32.112220 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:32.112182 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:39.495250 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:39.495208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:47.506961 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:47.506913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:16:57.203263 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:16:57.203213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:05.308710 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:05.308670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:14.199089 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:14.199047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:18.105581 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:18.105543 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:22.601767 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:22.601734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:32.398182 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:32.398096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:39.999489 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:39.999450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:48.905776 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:48.905738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:17:57.997095 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:17:57.997063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:18:07.328117 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:18:07.328079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:18:15.407185 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:18:15.407146 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:18:23.710951 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:18:23.710921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:18:32.402387 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:18:32.402307 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:18:41.801959 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:18:41.801907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:18:49.821887 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:18:49.821847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:19:06.076966 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:19:06.076937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:19:06.084832 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:19:06.084807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:21:07.209260 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:21:07.209223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:21:12.604384 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:21:12.604329 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:21:38.398056 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:21:38.398019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:21:43.098375 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:21:43.098327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:21:52.410249 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:21:52.410211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:22:02.908747 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:22:02.908663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:22:11.700553 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:22:11.700513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:22:22.402545 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:22:22.402506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:22:31.504645 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:22:31.504601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:22:42.040641 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:22:42.040602 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:22:50.915460 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:22:50.915416 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:23:01.528259 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:23:01.528211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:23:10.831964 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:23:10.831916 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:23:15.010611 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:23:15.010566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:23:43.854868 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:23:43.854782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:24:06.121567 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:24:06.121541 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:24:06.130200 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:24:06.130179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:24:26.674396 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:24:26.674357 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:24:35.229578 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:24:35.229538 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:24:43.833323 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:24:43.833286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:24:54.530000 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:24:54.529903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:03.247054 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:03.247016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:13.715139 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:13.715103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:23.008097 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:23.008061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:30.420955 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:30.420913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:39.204904 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:39.204866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:47.714293 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:47.714256 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:25:55.937515 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:25:55.937472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:26:06.204382 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:26:06.204323 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:26:24.017197 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:26:24.017117 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:26:32.857749 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:26:32.857712 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:26:41.302445 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:26:41.302409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:26:49.210270 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:26:49.210227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:06.803629 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:06.803597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:15.307565 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:15.307525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:23.923504 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:23.923463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:32.708517 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:32.708477 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:41.306275 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:41.306237 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:49.807119 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:49.807083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:27:59.014527 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:27:59.014441 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:10.197197 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:10.197156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:18.921728 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:18.921688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:30.226531 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:30.226499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:39.620212 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:39.620169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:45.207281 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:45.207244 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:53.529291 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:53.529253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:28:57.305205 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:28:57.305169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:29:00.121316 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:00.121278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:29:06.160150 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:06.160125 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:29:06.177125 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:06.177084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdt6r_5b7caeac-91b0-4307-9d5f-efda8b67df5f/ovn-acl-logging/0.log" Jun 10 13:29:15.722097 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:15.722057 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:29:24.612011 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:24.611937 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:29:34.047424 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:34.047390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:29:41.011266 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:29:41.011225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:30:05.211840 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:05.211794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:30:17.543175 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:17.543131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:30:22.105808 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:22.105765 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hg64k"] Jun 10 13:30:57.712761 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:57.712679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dd7b5d84c-pkr22_e7110c7b-1233-4477-8e00-b6454107c349/nginx/0.log" Jun 10 13:30:57.834791 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:57.834764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7g9pl_b20f08e8-0b69-45e2-aae3-4073fd67a04a/manager/0.log" Jun 10 13:30:57.959693 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:57.959665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-24t8m_988d6e78-82df-4733-a09c-2e9c5c1012a8/manager/0.log" Jun 10 13:30:58.427639 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:58.427609 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b697cffb7-fpg8b_c92ef33b-244e-4f8e-b2af-b2a2d3cc5395/manager/0.log" Jun 10 13:30:58.536831 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:58.536803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xg49q_a4a25020-0bf6-404c-8018-d9ff9a886904/server/0.log" Jun 10 13:30:58.898959 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:58.898933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb4db9f45-lmggj_4476c7c0-ad29-4ea6-91dd-7f081cdb8c13/copy-manifests/0.log" Jun 10 13:30:58.908519 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:58.908495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb4db9f45-lmggj_4476c7c0-ad29-4ea6-91dd-7f081cdb8c13/manager/0.log" Jun 10 13:30:59.970795 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:59.970761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6_f9a551df-6513-4f36-b2fc-70424ab8c6a0/util/0.log" Jun 10 13:30:59.982250 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:59.982225 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6_f9a551df-6513-4f36-b2fc-70424ab8c6a0/pull/0.log" Jun 10 13:30:59.991667 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:30:59.991646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6_f9a551df-6513-4f36-b2fc-70424ab8c6a0/extract/0.log" Jun 10 13:31:00.110496 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.110465 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857_8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7/util/0.log" Jun 10 13:31:00.118788 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.118767 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857_8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7/pull/0.log" Jun 10 13:31:00.131163 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.131141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857_8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7/extract/0.log" Jun 10 13:31:00.244044 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.243964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq_a5b36a67-70d2-4f72-b7ca-5a9cc1e18234/util/0.log" Jun 10 13:31:00.252534 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.252507 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq_a5b36a67-70d2-4f72-b7ca-5a9cc1e18234/pull/0.log" Jun 10 13:31:00.262443 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.262418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq_a5b36a67-70d2-4f72-b7ca-5a9cc1e18234/extract/0.log" Jun 10 13:31:00.379030 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.378999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj_43f0f2ed-40bd-43cd-98a0-61ab4e553dab/extract/0.log" Jun 10 13:31:00.388713 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.388690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj_43f0f2ed-40bd-43cd-98a0-61ab4e553dab/util/0.log" Jun 10 13:31:00.398452 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.398423 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj_43f0f2ed-40bd-43cd-98a0-61ab4e553dab/pull/0.log" Jun 10 13:31:00.647748 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.647722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ckmxg_a961c731-febd-44c1-998b-178b40c0aab0/manager/0.log" Jun 10 13:31:00.764030 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:00.764002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fxhmn_b87f1c57-2e27-42da-b3a0-bff692b8ce4a/manager/0.log" Jun 10 13:31:01.250386 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:01.250334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hg64k_2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d/limitador/0.log" Jun 10 13:31:01.844101 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:01.844073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zdnr2_495fa020-a702-4c3e-91c2-c14414045da9/discovery/0.log" Jun 10 13:31:02.066472 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:02.066441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b87c4dc87-lwkpk_c3da7500-85af-446f-b6bf-bcfec8648f51/kube-auth-proxy/0.log" Jun 10 13:31:02.438812 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:02.438780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-svm5f_9852d44a-9d27-4261-9155-1e6e46e680ef/payload-processing/0.log" Jun 10 13:31:03.152569 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:03.152541 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5_ae659688-af51-478d-bd4f-0a6c29bd5b84/storage-initializer/0.log" Jun 10 13:31:03.162715 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:03.162689 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vkrm5_ae659688-af51-478d-bd4f-0a6c29bd5b84/main/0.log" Jun 10 13:31:03.419061 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:03.418989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rghtl_952d5f53-6096-4834-8a57-984aa4ee5962/storage-initializer/0.log" Jun 10 13:31:03.428495 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:03.428472 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rghtl_952d5f53-6096-4834-8a57-984aa4ee5962/main/0.log" Jun 10 13:31:11.463614 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:11.463588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rxbfg_dada88db-0cd9-4016-bb87-f117c43fc853/global-pull-secret-syncer/0.log" Jun 10 13:31:11.554195 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:11.554161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zfzkc_59c6be98-fbab-4edf-8d64-90abfa398159/konnectivity-agent/0.log" Jun 10 13:31:11.648013 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:11.647975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-84.ec2.internal_deea8562724b7e4293feb704178fae5c/haproxy/0.log" Jun 10 13:31:14.213563 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:14.213526 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-9bnlr_e62cb9a0-6277-4e41-87f6-45ab8852bd05/sail-operator/0.log" Jun 10 13:31:16.447075 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.447040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6_f9a551df-6513-4f36-b2fc-70424ab8c6a0/extract/0.log" Jun 10 13:31:16.483226 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.483192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6_f9a551df-6513-4f36-b2fc-70424ab8c6a0/util/0.log" Jun 10 13:31:16.512414 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.512390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75974cv6_f9a551df-6513-4f36-b2fc-70424ab8c6a0/pull/0.log" Jun 10 13:31:16.547402 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.547376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857_8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7/extract/0.log" Jun 10 13:31:16.597593 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.597564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857_8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7/util/0.log" Jun 10 13:31:16.627033 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.627012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dn857_8b1cb0e2-53ae-46e2-9fe6-8dcfbf6b79c7/pull/0.log" Jun 10 13:31:16.662244 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.662207 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq_a5b36a67-70d2-4f72-b7ca-5a9cc1e18234/extract/0.log" Jun 10 13:31:16.694854 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.694826 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq_a5b36a67-70d2-4f72-b7ca-5a9cc1e18234/util/0.log" Jun 10 13:31:16.726482 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.726382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73plgdq_a5b36a67-70d2-4f72-b7ca-5a9cc1e18234/pull/0.log" Jun 10 13:31:16.759745 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.759723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj_43f0f2ed-40bd-43cd-98a0-61ab4e553dab/extract/0.log" Jun 10 13:31:16.786654 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.786628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj_43f0f2ed-40bd-43cd-98a0-61ab4e553dab/util/0.log" Jun 10 13:31:16.817517 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:16.817482 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xbtj_43f0f2ed-40bd-43cd-98a0-61ab4e553dab/pull/0.log" Jun 10 13:31:17.128930 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:17.128890 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ckmxg_a961c731-febd-44c1-998b-178b40c0aab0/manager/0.log" Jun 10 13:31:17.204263 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:17.204232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fxhmn_b87f1c57-2e27-42da-b3a0-bff692b8ce4a/manager/0.log" Jun 10 13:31:17.438615 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:17.438538 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hg64k_2e5acb9a-8bc9-4ea5-ac6d-6937f244f26d/limitador/0.log" Jun 10 13:31:19.613499 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.613470 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-hb4c7_fcdd764c-d9ea-4d67-b002-a795b034b2f3/kube-state-metrics/0.log" Jun 10 13:31:19.644716 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.644692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-hb4c7_fcdd764c-d9ea-4d67-b002-a795b034b2f3/kube-rbac-proxy-main/0.log" Jun 10 13:31:19.680476 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.680447 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-hb4c7_fcdd764c-d9ea-4d67-b002-a795b034b2f3/kube-rbac-proxy-self/0.log" Jun 10 13:31:19.754840 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.754810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-765t8_73ad9444-42d0-4f42-a0e3-59279cdf5d44/monitoring-plugin/0.log" Jun 10 13:31:19.794297 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.794269 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwvk6_5bf8a9ca-54a9-466d-b9b3-090456f071e8/node-exporter/0.log" Jun 10 13:31:19.822310 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.822279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwvk6_5bf8a9ca-54a9-466d-b9b3-090456f071e8/kube-rbac-proxy/0.log" Jun 10 13:31:19.853165 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:19.853137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwvk6_5bf8a9ca-54a9-466d-b9b3-090456f071e8/init-textfile/0.log" Jun 10 13:31:20.654545 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.654517 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fsz5h_28f08889-8be1-41b7-a935-cc8108d04bde/prometheus-operator-admission-webhook/0.log" Jun 10 13:31:20.793363 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.793321 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845dffccc-lxwv8_e144e0ab-47f8-47d9-bc28-f28219fbf388/thanos-query/0.log" Jun 10 13:31:20.827356 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.827330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845dffccc-lxwv8_e144e0ab-47f8-47d9-bc28-f28219fbf388/kube-rbac-proxy-web/0.log" Jun 10 13:31:20.854066 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.854039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845dffccc-lxwv8_e144e0ab-47f8-47d9-bc28-f28219fbf388/kube-rbac-proxy/0.log" Jun 10 13:31:20.883290 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.883260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845dffccc-lxwv8_e144e0ab-47f8-47d9-bc28-f28219fbf388/prom-label-proxy/0.log" Jun 10 13:31:20.911423 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.911303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845dffccc-lxwv8_e144e0ab-47f8-47d9-bc28-f28219fbf388/kube-rbac-proxy-rules/0.log" Jun 10 13:31:20.940562 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:20.940537 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-845dffccc-lxwv8_e144e0ab-47f8-47d9-bc28-f28219fbf388/kube-rbac-proxy-metrics/0.log" Jun 10 13:31:22.502033 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.501990 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k"] Jun 10 13:31:22.505740 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.505715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.508378 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.508340 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjqbr\"/\"kube-root-ca.crt\"" Jun 10 13:31:22.508519 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.508409 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjqbr\"/\"openshift-service-ca.crt\"" Jun 10 13:31:22.509232 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.509215 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rjqbr\"/\"default-dockercfg-gcscx\"" Jun 10 13:31:22.516381 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.516340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k"] Jun 10 13:31:22.603414 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.603381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-proc\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.603594 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.603428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-sys\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.603594 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.603484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-lib-modules\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.603594 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.603506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-podres\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.603594 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.603584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrnz\" (UniqueName: \"kubernetes.io/projected/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-kube-api-access-zrrnz\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704206 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-proc\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704206 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-sys\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-lib-modules\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-podres\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-sys\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrnz\" (UniqueName: \"kubernetes.io/projected/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-kube-api-access-zrrnz\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-proc\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-lib-modules\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.704447 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.704416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-podres\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.714452 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.714430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrnz\" (UniqueName: \"kubernetes.io/projected/2d7bdba5-ba5d-47f5-9460-d261e8e7be89-kube-api-access-zrrnz\") pod \"perf-node-gather-daemonset-bwk9k\" (UID: \"2d7bdba5-ba5d-47f5-9460-d261e8e7be89\") " pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.817706 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.817673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:22.961584 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:22.961550 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k"] Jun 10 13:31:22.963732 ip-10-0-128-84 kubenswrapper[2576]: W0610 13:31:22.963704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d7bdba5_ba5d_47f5_9460_d261e8e7be89.slice/crio-234edf8dab239224dea180a9de9a87ad90c1f6e1c046cd19ce084e1978727917 WatchSource:0}: Error finding container 234edf8dab239224dea180a9de9a87ad90c1f6e1c046cd19ce084e1978727917: Status 404 returned error can't find the container with id 234edf8dab239224dea180a9de9a87ad90c1f6e1c046cd19ce084e1978727917 Jun 10 13:31:23.157217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:23.157127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" event={"ID":"2d7bdba5-ba5d-47f5-9460-d261e8e7be89","Type":"ContainerStarted","Data":"71e0c58e79c96e8a2f9222ddc6a5421db820e591ee6f12abd3a799f6eda02204"} Jun 10 13:31:23.157217 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:23.157190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" event={"ID":"2d7bdba5-ba5d-47f5-9460-d261e8e7be89","Type":"ContainerStarted","Data":"234edf8dab239224dea180a9de9a87ad90c1f6e1c046cd19ce084e1978727917"} Jun 10 13:31:23.157413 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:23.157250 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:23.176471 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:23.176416 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" podStartSLOduration=1.1763983040000001 podStartE2EDuration="1.176398304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:31:23.174472509 +0000 UTC m=+2537.739454288" watchObservedRunningTime="2026-06-10 13:31:23.176398304 +0000 UTC m=+2537.741380054" Jun 10 13:31:23.578773 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:23.578736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-t94dv_e0467961-bfa3-48ed-9cfb-8ae8982270c3/download-server/0.log" Jun 10 13:31:25.525689 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:25.525661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvllb_c70fcc1a-30b6-45e5-acd5-ef05efbddc7a/dns/0.log" Jun 10 13:31:25.552910 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:25.552886 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvllb_c70fcc1a-30b6-45e5-acd5-ef05efbddc7a/kube-rbac-proxy/0.log" Jun 10 13:31:25.644793 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:25.644764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gfff_3604a740-60af-4080-b48a-d4b2e564bea2/dns-node-resolver/0.log" Jun 10 13:31:26.346948 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:26.346920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2l9wh_68a65828-4c10-4af2-9ce8-f8a1549c6ace/node-ca/0.log" Jun 10 13:31:27.588467 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:27.588432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zdnr2_495fa020-a702-4c3e-91c2-c14414045da9/discovery/0.log" Jun 10 13:31:27.691036 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:27.691007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b87c4dc87-lwkpk_c3da7500-85af-446f-b6bf-bcfec8648f51/kube-auth-proxy/0.log" Jun 10 13:31:27.909055 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:27.908970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-svm5f_9852d44a-9d27-4261-9155-1e6e46e680ef/payload-processing/0.log" Jun 10 13:31:28.663366 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:28.663328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c8ngv_4856e0b3-42af-4310-ae88-47fd9bb79ea8/serve-healthcheck-canary/0.log" Jun 10 13:31:29.172796 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:29.172770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rjqbr/perf-node-gather-daemonset-bwk9k" Jun 10 13:31:29.413762 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:29.413735 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lgtr5_c73a55a6-c1e3-40b1-90f8-451c4925cc3d/kube-rbac-proxy/0.log" Jun 10 13:31:29.441961 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:29.441894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lgtr5_c73a55a6-c1e3-40b1-90f8-451c4925cc3d/exporter/0.log" Jun 10 13:31:29.474161 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:29.474137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lgtr5_c73a55a6-c1e3-40b1-90f8-451c4925cc3d/extractor/0.log" Jun 10 13:31:32.259530 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.259496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dd7b5d84c-pkr22_e7110c7b-1233-4477-8e00-b6454107c349/nginx/0.log" Jun 10 13:31:32.302360 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.302318 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7g9pl_b20f08e8-0b69-45e2-aae3-4073fd67a04a/manager/0.log" Jun 10 13:31:32.396070 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.396039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-24t8m_988d6e78-82df-4733-a09c-2e9c5c1012a8/manager/0.log" Jun 10 13:31:32.589373 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.589327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b697cffb7-fpg8b_c92ef33b-244e-4f8e-b2af-b2a2d3cc5395/manager/0.log" Jun 10 13:31:32.622035 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.622012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xg49q_a4a25020-0bf6-404c-8018-d9ff9a886904/server/0.log" Jun 10 13:31:32.904583 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.904495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb4db9f45-lmggj_4476c7c0-ad29-4ea6-91dd-7f081cdb8c13/manager/0.log" Jun 10 13:31:32.932602 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:32.932569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb4db9f45-lmggj_4476c7c0-ad29-4ea6-91dd-7f081cdb8c13/copy-manifests/0.log" Jun 10 13:31:36.200545 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:36.200513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zdnr2_495fa020-a702-4c3e-91c2-c14414045da9/discovery/0.log" Jun 10 13:31:36.234950 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:36.234920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b87c4dc87-lwkpk_c3da7500-85af-446f-b6bf-bcfec8648f51/kube-auth-proxy/0.log" Jun 10 13:31:36.378735 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:36.378704 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-svm5f_9852d44a-9d27-4261-9155-1e6e46e680ef/payload-processing/0.log" Jun 10 13:31:37.567298 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:37.567264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zdnr2_495fa020-a702-4c3e-91c2-c14414045da9/discovery/0.log" Jun 10 13:31:37.602166 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:37.602135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b87c4dc87-lwkpk_c3da7500-85af-446f-b6bf-bcfec8648f51/kube-auth-proxy/0.log" Jun 10 13:31:37.756598 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:37.756565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-svm5f_9852d44a-9d27-4261-9155-1e6e46e680ef/payload-processing/0.log" Jun 10 13:31:39.589760 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:39.589727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zdnr2_495fa020-a702-4c3e-91c2-c14414045da9/discovery/0.log" Jun 10 13:31:39.634697 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:39.634664 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b87c4dc87-lwkpk_c3da7500-85af-446f-b6bf-bcfec8648f51/kube-auth-proxy/0.log" Jun 10 13:31:39.791913 ip-10-0-128-84 kubenswrapper[2576]: I0610 13:31:39.791883 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-svm5f_9852d44a-9d27-4261-9155-1e6e46e680ef/payload-processing/0.log"