Jun 05 17:48:57.853985 ip-10-0-128-168 systemd[1]: Starting Kubernetes Kubelet... Jun 05 17:48:58.261237 ip-10-0-128-168 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:48:58.261237 ip-10-0-128-168 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 17:48:58.261237 ip-10-0-128-168 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:48:58.261237 ip-10-0-128-168 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 17:48:58.261237 ip-10-0-128-168 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:48:58.263975 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.263883 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 17:48:58.270257 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270232 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:58.270257 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270252 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:58.270257 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270256 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:58.270257 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270259 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:58.270257 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270262 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:58.270257 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270266 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270270 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270275 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270279 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270283 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270289 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270292 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270296 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270300 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270304 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270308 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270310 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270313 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270316 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270318 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270321 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270324 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270327 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270332 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:58.270479 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270334 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270337 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270340 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270343 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270346 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270349 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270351 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270354 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270357 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270360 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270363 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270368 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270371 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270374 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270377 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270380 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270385 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270387 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270390 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270393 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:58.270967 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270396 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270399 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270402 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270407 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270409 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270412 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270415 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270417 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270420 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270424 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270427 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270429 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270432 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270435 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270457 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270460 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270466 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270469 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270473 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270476 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:58.271455 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270479 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270482 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270485 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270488 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270491 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270494 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270497 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270501 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270506 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270509 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270512 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270515 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270518 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270521 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270523 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270526 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270529 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270532 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270537 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:58.271946 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270540 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270546 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270549 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270552 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270555 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270558 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270560 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270563 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270566 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270568 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270571 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270574 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270578 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270583 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270585 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.270588 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271748 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271758 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271763 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:58.272395 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271766 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271769 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271772 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271778 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271782 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271785 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271787 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271790 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271793 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271796 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271799 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271801 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271804 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271807 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271810 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271815 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271817 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271820 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271823 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271826 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:58.272862 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271828 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271831 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271833 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271837 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271840 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271843 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271846 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271849 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271854 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271862 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271870 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271875 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271880 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271884 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271888 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271892 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271897 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271901 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271909 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.271961 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:58.273358 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272081 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272086 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272090 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272093 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272096 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272099 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272104 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272107 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272110 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272113 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272115 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272118 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272121 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272124 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272127 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272130 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272132 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272135 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272138 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272141 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:58.273863 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272143 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272148 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272154 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272157 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272160 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272164 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272167 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272170 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272173 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272175 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272178 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272181 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272184 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272187 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272189 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272192 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272195 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272197 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272200 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:58.274348 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272203 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272206 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272208 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272211 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272214 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272216 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272219 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272223 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272226 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272228 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272233 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272236 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272240 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272242 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272246 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272249 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272251 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272689 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272694 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272697 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:58.274951 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272700 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272703 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272706 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272708 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272712 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272715 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272717 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272720 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272723 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272725 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272728 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272730 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272733 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272736 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272738 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272741 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272744 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272746 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272749 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272751 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:58.275431 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272754 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272756 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272759 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272761 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272764 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272766 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272769 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272772 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272774 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272777 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272780 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272783 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272785 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272790 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272793 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272796 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272800 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272804 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272806 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272809 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:58.275931 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272812 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272814 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272817 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272820 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272822 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272825 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272828 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272831 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272833 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272836 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272839 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272841 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272844 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272846 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272849 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272851 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272854 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272857 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272859 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:58.276444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272861 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272864 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272868 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272871 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272875 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272878 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272881 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272884 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272886 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272890 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272895 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272898 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272900 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272903 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272906 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272908 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272911 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272913 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272916 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:58.276915 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272918 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272921 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272924 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272927 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272929 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272931 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272934 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272937 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272939 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272942 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272944 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272946 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272950 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272954 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272957 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272959 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272962 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.272964 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273042 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273050 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273057 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 17:48:58.277385 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273062 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273067 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273071 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273076 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273080 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273083 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273086 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273089 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273093 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273096 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273099 2579 flags.go:64] FLAG: --cgroup-root="" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273102 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273105 2579 flags.go:64] FLAG: --client-ca-file="" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273110 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273113 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273117 2579 flags.go:64] FLAG: --cluster-domain="" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273120 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273123 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273126 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273129 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273133 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273136 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273139 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 17:48:58.277951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273142 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273145 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273148 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273151 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273154 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273158 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273162 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273165 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273168 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273171 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273174 2579 flags.go:64] FLAG: --enable-server="true" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273177 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273182 2579 flags.go:64] FLAG: --event-burst="100" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273186 2579 flags.go:64] FLAG: --event-qps="50" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273189 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273192 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273195 2579 flags.go:64] FLAG: --eviction-hard="" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273199 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273202 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273205 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273208 2579 flags.go:64] FLAG: --eviction-soft="" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273211 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273214 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273218 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273221 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 17:48:58.278511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273224 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273226 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273229 2579 flags.go:64] FLAG: --feature-gates="" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273233 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273236 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273239 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273242 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273245 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273248 2579 flags.go:64] FLAG: --help="false" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273251 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273254 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273257 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273260 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273264 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273267 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273271 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273274 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273277 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273280 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273283 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273286 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273289 2579 flags.go:64] FLAG: --kube-reserved="" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273292 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273295 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 17:48:58.279192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273298 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273301 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273304 2579 flags.go:64] FLAG: --lock-file="" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273307 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273309 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273313 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273323 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273326 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273329 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273332 2579 flags.go:64] FLAG: --logging-format="text" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273335 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273339 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273342 2579 flags.go:64] FLAG: --manifest-url="" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273345 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273349 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273352 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273356 2579 flags.go:64] FLAG: --max-pods="110" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273359 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273363 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273366 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273369 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273372 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273375 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273378 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273385 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 17:48:58.279898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273388 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273392 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273395 2579 flags.go:64] FLAG: --pod-cidr="" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273398 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273403 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273406 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273410 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273413 2579 flags.go:64] FLAG: --port="10250" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273416 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273419 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0944fdfab4d8d67b5" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273422 2579 flags.go:64] FLAG: --qos-reserved="" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273425 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273428 2579 flags.go:64] FLAG: --register-node="true" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273431 2579 flags.go:64] FLAG: --register-with-taints="" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273435 2579 flags.go:64] FLAG: --registry-burst="10" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273438 2579 flags.go:64] FLAG: --registry-qps="5" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273442 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273445 2579 flags.go:64] FLAG: --reserved-memory="" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273448 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273452 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273454 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273458 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273461 2579 flags.go:64] FLAG: --runonce="false" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273466 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273470 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 17:48:58.280511 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273473 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273476 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273479 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273482 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273485 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273488 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273491 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273497 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273500 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273503 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273506 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273509 2579 flags.go:64] FLAG: --system-cgroups="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273512 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273518 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273520 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273524 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273527 2579 flags.go:64] FLAG: --tls-min-version="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273530 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273533 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273536 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273539 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273542 2579 flags.go:64] FLAG: --v="2" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273546 2579 flags.go:64] FLAG: --version="false" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273552 2579 flags.go:64] FLAG: --vmodule="" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273559 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 17:48:58.281143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273562 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273691 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273695 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273699 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273702 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273706 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273709 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273711 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273714 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273717 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273719 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273723 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273726 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273729 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273733 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273735 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273738 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273741 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273743 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:58.281770 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273746 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273749 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273751 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273754 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273757 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273759 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273762 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273765 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273767 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273770 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273773 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273775 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273779 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273781 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273784 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273786 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273789 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273792 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273795 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273798 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:58.282228 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273801 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273803 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273806 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273808 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273811 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273813 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273816 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273820 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273823 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273825 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273828 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273830 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273833 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273836 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273838 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273842 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273845 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273848 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273850 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273853 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:58.282738 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273855 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273858 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273860 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273863 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273867 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273871 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273875 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273879 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273882 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273885 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273890 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273893 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273896 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273898 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273901 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273904 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273907 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273910 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273913 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:58.283237 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273917 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273920 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273923 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273925 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273928 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273931 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273934 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273937 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273940 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273942 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273945 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273948 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273950 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273953 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273955 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273958 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273961 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273964 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273967 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273970 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:58.283713 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273973 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.273977 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.273982 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.281121 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.281136 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.281964 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.281971 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282033 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282039 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282042 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282046 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282048 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282051 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282054 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282057 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:58.284197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282059 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282062 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282065 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282067 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282070 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282073 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282076 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282079 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282082 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282085 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282088 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282090 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282096 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282098 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282101 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282104 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282107 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282110 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282112 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:58.284574 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282115 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282118 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282121 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282124 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282127 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282129 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282132 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282134 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282137 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282140 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282142 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282145 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282147 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282152 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282156 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282159 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282162 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282166 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282169 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:58.285102 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282171 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282175 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282177 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282180 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282182 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282185 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282187 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282191 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282195 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282198 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282201 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282204 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282207 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282210 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282214 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282217 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282219 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282222 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282225 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:58.285562 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282227 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282230 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282233 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282236 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282239 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282242 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282245 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282247 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282250 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282253 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282255 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282258 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282261 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282263 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282266 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282268 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282271 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282274 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282276 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282279 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:58.286045 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282282 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282284 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282287 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282289 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282293 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282296 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282298 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282301 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282304 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282307 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282310 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282312 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282315 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.282321 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282437 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:58.286529 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282441 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282444 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282447 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282450 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282453 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282457 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282460 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282463 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282466 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282469 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282471 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282474 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282476 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282479 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282482 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282484 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282487 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282489 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282492 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282494 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:58.286926 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282497 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282500 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282503 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282505 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282508 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282511 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282514 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282517 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282519 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282522 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282525 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282528 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282530 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282533 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282535 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282539 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282542 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282545 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282549 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282552 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:58.287408 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282555 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282558 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282561 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282564 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282567 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282569 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282572 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282575 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282577 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282580 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282583 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282586 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282588 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282591 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282594 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282597 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282599 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282602 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282604 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:58.287979 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282607 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282609 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282612 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282614 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282617 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282619 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282636 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282639 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282642 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282645 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282647 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282650 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282652 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282655 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282657 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282660 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282662 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282665 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282667 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:58.288444 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282670 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282673 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282676 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282679 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282683 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282686 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282689 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282692 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282695 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282697 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282701 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282703 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282706 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282709 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282711 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282714 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282716 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282719 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282721 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:58.288913 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:58.282724 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.282729 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.282862 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.284803 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.286085 2579 server.go:1019] "Starting client certificate rotation" Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.286181 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.286219 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 17:48:58.289370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.289069 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 17:48:58.290670 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.290653 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 17:48:58.304615 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.304591 2579 log.go:25] "Validated CRI v1 runtime API" Jun 05 17:48:58.307802 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.307776 2579 log.go:25] "Validated CRI v1 image API" Jun 05 17:48:58.308592 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.308575 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 17:48:58.312516 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.312500 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 17:48:58.313007 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.312987 2579 fs.go:135] Filesystem UUIDs: map[614a866b-0631-4005-9945-dcabb5dbc870:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8358604e-6dc5-496e-88fa-6541be22ad0d:/dev/nvme0n1p3] Jun 05 17:48:58.313054 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.313007 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 17:48:58.318488 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.318364 2579 manager.go:216] Machine: {Timestamp:2026-06-05 17:48:58.316765769 +0000 UTC m=+0.345500699 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100387 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df6ea92867a9c62704f7a370e736f SystemUUID:ec2df6ea-9286-7a9c-6270-4f7a370e736f BootID:506fc240-c807-4a9f-99f7-c82544cbb122 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:8e:ea:b2:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:8e:ea:b2:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:8e:4c:25:cb:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 17:48:58.318488 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.318485 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 17:48:58.318633 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.318610 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 17:48:58.321831 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.321802 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 17:48:58.321985 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.321834 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 17:48:58.322658 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.322648 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 17:48:58.322697 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.322662 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 17:48:58.322697 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.322670 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 17:48:58.323401 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.323390 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 17:48:58.324432 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.324421 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 17:48:58.327191 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327176 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 17:48:58.327503 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327492 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 17:48:58.327533 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327527 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 05 17:48:58.327563 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327538 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 17:48:58.327563 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327553 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 17:48:58.327563 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327563 2579 kubelet.go:398] "Adding apiserver pod source" Jun 05 17:48:58.327729 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327573 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 17:48:58.327987 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327967 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 17:48:58.327987 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.327990 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 17:48:58.331333 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.331310 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 17:48:58.332925 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.332907 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 17:48:58.333030 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.332945 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 17:48:58.334036 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334021 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334041 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334051 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334059 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334072 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334081 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334093 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334101 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334111 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 17:48:58.334117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334119 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 17:48:58.334384 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334132 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 17:48:58.334384 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.334141 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 17:48:58.335606 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.335587 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 17:48:58.335606 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.335602 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 17:48:58.336316 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.336279 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2vtvq" Jun 05 17:48:58.338007 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.337988 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 17:48:58.338682 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.338657 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 17:48:58.338748 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.338693 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 17:48:58.339019 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.339007 2579 server.go:1268] "Started kubelet" Jun 05 17:48:58.339136 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.339109 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 17:48:58.339681 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.339599 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 17:48:58.339762 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.339709 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 17:48:58.339909 ip-10-0-128-168 systemd[1]: Started Kubernetes Kubelet. Jun 05 17:48:58.341439 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.341234 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 17:48:58.341514 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.341455 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 05 17:48:58.342952 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.342922 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2vtvq" Jun 05 17:48:58.348649 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.344557 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-168.ec2.internal.18b6409b47b84652 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-168.ec2.internal,UID:ip-10-0-128-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-168.ec2.internal,},FirstTimestamp:2026-06-05 17:48:58.338977362 +0000 UTC m=+0.367712274,LastTimestamp:2026-06-05 17:48:58.338977362 +0000 UTC m=+0.367712274,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-168.ec2.internal,}" Jun 05 17:48:58.348856 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.348831 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 17:48:58.349336 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349324 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 17:48:58.349394 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349370 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 17:48:58.349484 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.349457 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.349834 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349817 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 17:48:58.349834 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349835 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 17:48:58.349979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349969 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 05 17:48:58.349979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349978 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 05 17:48:58.350063 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.349996 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 17:48:58.350288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350269 2579 factory.go:55] Registering systemd factory Jun 05 17:48:58.350353 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350292 2579 factory.go:223] Registration of the systemd container factory successfully Jun 05 17:48:58.350521 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350504 2579 factory.go:153] Registering CRI-O factory Jun 05 17:48:58.350521 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350522 2579 factory.go:223] Registration of the crio container factory successfully Jun 05 17:48:58.350643 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350596 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 17:48:58.350643 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350615 2579 factory.go:103] Registering Raw factory Jun 05 17:48:58.350643 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350642 2579 manager.go:1196] Started watching for new ooms in manager Jun 05 17:48:58.350980 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.350965 2579 manager.go:349] Starting recovery of all containers Jun 05 17:48:58.359689 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.359667 2579 manager.go:354] Recovery completed Jun 05 17:48:58.363330 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.363145 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:58.364103 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.364091 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.366029 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366012 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.366092 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366041 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.366092 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366062 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.366315 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.366299 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-168.ec2.internal\" not found" node="ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.366601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366590 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 17:48:58.366601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366598 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.366767 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366600 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 17:48:58.366767 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.366699 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 17:48:58.367401 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.367386 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.367452 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.367416 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.367452 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.367426 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.367892 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.367877 2579 policy_none.go:49] "None policy: Start" Jun 05 17:48:58.367951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.367896 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 17:48:58.367951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.367907 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 17:48:58.368767 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.368757 2579 policy_none.go:47] "Start" Jun 05 17:48:58.405326 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.405309 2579 manager.go:337] "Starting Device Plugin manager" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.405765 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.405784 2579 server.go:87] "Starting device plugin registration server" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.406102 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.406122 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.406595 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.406694 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.406705 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.408956 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.409013 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.418611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.418539 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 17:48:58.419803 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.419785 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 17:48:58.419844 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.419826 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 17:48:58.419876 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.419857 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 17:48:58.419918 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.419901 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 17:48:58.422747 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.422722 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:58.507293 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.507246 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.508311 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.508288 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.508429 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.508324 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.508429 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.508338 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.508429 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.508369 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.516661 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.516585 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.516661 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.516614 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-168.ec2.internal\": node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.519973 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.519949 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal"] Jun 05 17:48:58.520097 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.520021 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.521420 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.521403 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.521523 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.521431 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.521523 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.521442 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.522569 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.522555 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.522707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.522691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.522749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.522722 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.523262 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.523246 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.523336 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.523273 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.523336 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.523283 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.523336 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.523247 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.523439 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.523352 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.523439 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.523364 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.524288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.524275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.524375 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.524299 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:58.525668 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.525650 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:58.525758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.525686 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:58.525758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.525701 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:58.530160 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.530143 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.556477 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.556448 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-168.ec2.internal\" not found" node="ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.561074 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.561058 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-168.ec2.internal\" not found" node="ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.630701 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.630668 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.651873 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.651844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59cbe8b5e51f41f49bc87ba9b229c8d4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-168.ec2.internal\" (UID: \"59cbe8b5e51f41f49bc87ba9b229c8d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.651981 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.651886 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/716f94c0df12941e5969fa31f0453ce2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"716f94c0df12941e5969fa31f0453ce2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.651981 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.651906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/716f94c0df12941e5969fa31f0453ce2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"716f94c0df12941e5969fa31f0453ce2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.731069 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.731034 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.752423 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.752392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/716f94c0df12941e5969fa31f0453ce2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"716f94c0df12941e5969fa31f0453ce2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.752536 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.752427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/716f94c0df12941e5969fa31f0453ce2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"716f94c0df12941e5969fa31f0453ce2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.752536 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.752445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59cbe8b5e51f41f49bc87ba9b229c8d4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-168.ec2.internal\" (UID: \"59cbe8b5e51f41f49bc87ba9b229c8d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.752536 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.752505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/716f94c0df12941e5969fa31f0453ce2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"716f94c0df12941e5969fa31f0453ce2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.752669 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.752558 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59cbe8b5e51f41f49bc87ba9b229c8d4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-168.ec2.internal\" (UID: \"59cbe8b5e51f41f49bc87ba9b229c8d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.752669 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.752591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/716f94c0df12941e5969fa31f0453ce2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal\" (UID: \"716f94c0df12941e5969fa31f0453ce2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.831909 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.831834 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:58.860378 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.860355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.865121 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:58.865098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jun 05 17:48:58.932795 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:58.932757 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.033357 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.033319 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.133839 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.133800 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.234381 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.234343 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.285908 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.285840 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 17:48:59.286699 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.286024 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 17:48:59.286699 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.286064 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 17:48:59.335365 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.335330 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.349734 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.349679 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 17:43:58 +0000 UTC" deadline="2028-01-22 00:51:18.907918572 +0000 UTC" Jun 05 17:48:59.349734 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.349734 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14287h2m19.558189596s" Jun 05 17:48:59.351299 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:59.351264 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716f94c0df12941e5969fa31f0453ce2.slice/crio-8a6d6f92f139c6e4c60cda6e5b6df4e028f923575c6a7cf7c75cb76a2a047fc3 WatchSource:0}: Error finding container 8a6d6f92f139c6e4c60cda6e5b6df4e028f923575c6a7cf7c75cb76a2a047fc3: Status 404 returned error can't find the container with id 8a6d6f92f139c6e4c60cda6e5b6df4e028f923575c6a7cf7c75cb76a2a047fc3 Jun 05 17:48:59.351518 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:48:59.351493 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cbe8b5e51f41f49bc87ba9b229c8d4.slice/crio-aa7f79628cc50f1be5f2b5bc1457711f4c70bbebd07ed88dad0b94ab65ef5c6a WatchSource:0}: Error finding container aa7f79628cc50f1be5f2b5bc1457711f4c70bbebd07ed88dad0b94ab65ef5c6a: Status 404 returned error can't find the container with id aa7f79628cc50f1be5f2b5bc1457711f4c70bbebd07ed88dad0b94ab65ef5c6a Jun 05 17:48:59.356585 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.356567 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 17:48:59.423044 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.422937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" event={"ID":"59cbe8b5e51f41f49bc87ba9b229c8d4","Type":"ContainerStarted","Data":"aa7f79628cc50f1be5f2b5bc1457711f4c70bbebd07ed88dad0b94ab65ef5c6a"} Jun 05 17:48:59.423924 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.423899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" event={"ID":"716f94c0df12941e5969fa31f0453ce2","Type":"ContainerStarted","Data":"8a6d6f92f139c6e4c60cda6e5b6df4e028f923575c6a7cf7c75cb76a2a047fc3"} Jun 05 17:48:59.436112 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.436080 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.536567 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.536537 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.637102 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.637067 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.737682 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.737594 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.838444 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:48:59.838409 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-168.ec2.internal\" not found" Jun 05 17:48:59.859849 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.859811 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:59.884901 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.884869 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:59.949685 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.949656 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" Jun 05 17:48:59.961061 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.961034 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 17:48:59.962360 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.962338 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" Jun 05 17:48:59.971020 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:48:59.970995 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 17:49:00.151593 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.151566 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:00.289862 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.289833 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:00.329228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.329194 2579 apiserver.go:52] "Watching apiserver" Jun 05 17:49:00.335560 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.335527 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 17:49:00.336586 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.336562 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal","openshift-multus/multus-additional-cni-plugins-whg7s","openshift-multus/multus-k5gj6","openshift-network-diagnostics/network-check-target-wg6ld","openshift-network-operator/iptables-alerter-fh2rc","openshift-ovn-kubernetes/ovnkube-node-c8svm","kube-system/konnectivity-agent-bfrz4","kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6jwxf","openshift-dns/node-resolver-lf7vp","openshift-image-registry/node-ca-kmtjj","openshift-multus/network-metrics-daemon-gh45g","kube-system/global-pull-secret-syncer-pm5kp"] Jun 05 17:49:00.338482 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.338454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.339770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.339752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.339879 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.339815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:00.341090 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.341066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.341198 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.341103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 17:49:00.341801 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.341777 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 17:49:00.342729 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.342698 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.343136 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.343114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.344549 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.344526 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 17:49:00.344662 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.344617 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 17:49:00.344735 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.344690 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 17:49:00.344795 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.344525 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 17:49:00.345021 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.344991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.345643 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.345602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 17:49:00.345736 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.345640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hr64p\"" Jun 05 17:49:00.345801 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.345760 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.345852 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.345807 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.345932 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.345906 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nqgr6\"" Jun 05 17:49:00.347008 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.346989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:00.347123 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.347054 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:00.348204 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.348187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.348908 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.348876 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 17:49:00.349261 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.349244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6t2zd\"" Jun 05 17:49:00.349530 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.349504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.349690 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.349554 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:00.350107 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.350070 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 17:49:00.350445 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.350427 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 17:49:00.350553 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.350536 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.350617 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.350573 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.351291 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.350798 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhxl7\"" Jun 05 17:49:00.351291 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.351023 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.352214 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.352194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.353213 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.353193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.353305 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.353220 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 17:49:00.353400 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.353381 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hsvr2\"" Jun 05 17:49:00.353461 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.353389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.353717 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.353697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.354652 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.354605 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 17:49:00.354779 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.354694 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 17:49:00.354936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.354906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.355042 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.355025 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mhnjc\"" Jun 05 17:49:00.356695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.356236 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.356695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.356287 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sx6z9\"" Jun 05 17:49:00.356695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.356440 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.356695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.356588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.357357 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.357334 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wzcmm\"" Jun 05 17:49:00.357470 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.357451 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.357637 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.357597 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.358594 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.358574 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 17:49:00.358712 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.358578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 17:49:00.358863 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.358844 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 17:49:00.358995 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.358969 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ktd66\"" Jun 05 17:49:00.361604 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.361586 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 17:49:00.362744 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv6k5\" (UniqueName: \"kubernetes.io/projected/a2dd61d5-af30-4a36-9e88-6bcc55877abd-kube-api-access-kv6k5\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.362847 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-run-netns\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.362847 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-node-log\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.362847 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-cni-netd\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.362847 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:00.363033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ba16dce-991c-4df2-813e-cfb32a7c2434-dbus\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.363033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-etc-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-conf-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.363033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.362990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-socket-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.363033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-device-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-os-release\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-socket-dir-parent\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-systemd\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-run-ovn-kubernetes\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-os-release\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-kubelet\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.363306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhs9\" (UniqueName: \"kubernetes.io/projected/0367236e-a57f-49d9-9920-4021b9417521-kube-api-access-glhs9\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89bx5\" (UniqueName: \"kubernetes.io/projected/1e35ae7a-aef8-4911-b663-b7089ce43cf8-kube-api-access-89bx5\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-netns\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9cqm\" (UniqueName: \"kubernetes.io/projected/0afed098-ee13-41f5-a7d8-1c245a5127b7-kube-api-access-g9cqm\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-kubelet\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0367236e-a57f-49d9-9920-4021b9417521-ovn-node-metrics-cert\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-ovnkube-script-lib\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-etc-selinux\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-slash\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-registration-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.363724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-k8s-cni-cncf-io\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-cni-multus\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cnibin\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-cni-bin\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-daemon-config\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cni-binary-copy\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-cnibin\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.363993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfbb11d2-706c-4ff3-990a-68c079514c2f-cni-binary-copy\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ba16dce-991c-4df2-813e-cfb32a7c2434-kubelet-config\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-var-lib-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-log-socket\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-ovnkube-config\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-cni-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2dd61d5-af30-4a36-9e88-6bcc55877abd-host-slash\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-env-overrides\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.364354 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-hostroot\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-multus-certs\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcr9l\" (UniqueName: \"kubernetes.io/projected/dc458265-638b-4f51-9181-c3bf720f0384-kube-api-access-zcr9l\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2dd61d5-af30-4a36-9e88-6bcc55877abd-iptables-alerter-script\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-systemd-units\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-ovn\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-system-cni-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-etc-kubernetes\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-cni-bin\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-system-cni-dir\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5t9\" (UniqueName: \"kubernetes.io/projected/bfbb11d2-706c-4ff3-990a-68c079514c2f-kube-api-access-zf5t9\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.365096 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.364584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-sys-fs\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.379801 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.379779 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrgz5" Jun 05 17:49:00.386004 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.385982 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrgz5" Jun 05 17:49:00.451312 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.451277 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 17:49:00.464961 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.464919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf5bcd89-a970-4500-b305-9724b42454d0-etc-tuned\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.464967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-os-release\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.464997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-socket-dir-parent\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-systemd\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-run-ovn-kubernetes\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-os-release\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465084 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-os-release\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465087 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-socket-dir-parent\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465119 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-systemd\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465144 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-run-ovn-kubernetes\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465153 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465139 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-os-release\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-kubelet\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhs9\" (UniqueName: \"kubernetes.io/projected/0367236e-a57f-49d9-9920-4021b9417521-kube-api-access-glhs9\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89bx5\" (UniqueName: \"kubernetes.io/projected/1e35ae7a-aef8-4911-b663-b7089ce43cf8-kube-api-access-89bx5\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-netns\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9cqm\" (UniqueName: \"kubernetes.io/projected/0afed098-ee13-41f5-a7d8-1c245a5127b7-kube-api-access-g9cqm\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.465360 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-kubelet\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.465430 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:00.965399545 +0000 UTC m=+2.994134443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465445 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18478fc6-df84-4d19-922a-d1b7bb444bb6-host\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmgl\" (UniqueName: \"kubernetes.io/projected/18478fc6-df84-4d19-922a-d1b7bb444bb6-kube-api-access-cdmgl\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-kubelet\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0367236e-a57f-49d9-9920-4021b9417521-ovn-node-metrics-cert\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.465522 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-ovnkube-script-lib\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-etc-selinux\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2-konnectivity-ca\") pod \"konnectivity-agent-bfrz4\" (UID: \"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2\") " pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-sys\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-slash\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-registration-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-kubelet\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-modprobe-d\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-netns\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-k8s-cni-cncf-io\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465852 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-cni-multus\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cnibin\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-cni-bin\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-daemon-config\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.466273 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.465920 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-registration-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466015 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-slash\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-cni-multus\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-tmp-dir\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4wwf\" (UniqueName: \"kubernetes.io/projected/bf5bcd89-a970-4500-b305-9724b42454d0-kube-api-access-r4wwf\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-etc-selinux\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cni-binary-copy\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-k8s-cni-cncf-io\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-cnibin\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfbb11d2-706c-4ff3-990a-68c079514c2f-cni-binary-copy\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ba16dce-991c-4df2-813e-cfb32a7c2434-kubelet-config\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cnibin\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-var-lib-cni-bin\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-var-lib-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466412 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-ovnkube-script-lib\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-log-socket\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466433 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-log-socket\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ba16dce-991c-4df2-813e-cfb32a7c2434-kubelet-config\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466504 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-cnibin\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-var-lib-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-ovnkube-config\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-cni-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-cni-binary-copy\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-hosts-file\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-daemon-config\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2n5r\" (UniqueName: \"kubernetes.io/projected/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-kube-api-access-k2n5r\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-cni-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfbb11d2-706c-4ff3-990a-68c079514c2f-cni-binary-copy\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18478fc6-df84-4d19-922a-d1b7bb444bb6-serviceca\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysconfig\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-host\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.467957 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf5bcd89-a970-4500-b305-9724b42454d0-tmp\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2dd61d5-af30-4a36-9e88-6bcc55877abd-host-slash\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.466995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-env-overrides\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-hostroot\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.467049 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467070 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2dd61d5-af30-4a36-9e88-6bcc55877abd-host-slash\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-multus-certs\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.467113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:00.967078989 +0000 UTC m=+2.995813890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-host-run-multus-certs\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-hostroot\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-ovnkube-config\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcr9l\" (UniqueName: \"kubernetes.io/projected/dc458265-638b-4f51-9181-c3bf720f0384-kube-api-access-zcr9l\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysctl-conf\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2dd61d5-af30-4a36-9e88-6bcc55877abd-iptables-alerter-script\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-systemd-units\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-ovn\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.468783 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-system-cni-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-etc-kubernetes\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-run\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-var-lib-kubelet\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-cni-bin\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-system-cni-dir\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-systemd-units\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467439 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-etc-kubernetes\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-run-ovn\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467480 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-cni-bin\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467493 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e35ae7a-aef8-4911-b663-b7089ce43cf8-system-cni-dir\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5t9\" (UniqueName: \"kubernetes.io/projected/bfbb11d2-706c-4ff3-990a-68c079514c2f-kube-api-access-zf5t9\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-sys-fs\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv6k5\" (UniqueName: \"kubernetes.io/projected/a2dd61d5-af30-4a36-9e88-6bcc55877abd-kube-api-access-kv6k5\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-run-netns\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-sys-fs\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-node-log\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469366 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-cni-netd\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-run-netns\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-system-cni-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-kubernetes\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-node-log\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-host-cni-netd\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ba16dce-991c-4df2-813e-cfb32a7c2434-dbus\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467840 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0367236e-a57f-49d9-9920-4021b9417521-env-overrides\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467918 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2dd61d5-af30-4a36-9e88-6bcc55877abd-iptables-alerter-script\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-etc-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-conf-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ba16dce-991c-4df2-813e-cfb32a7c2434-dbus\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-socket-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2-agent-certs\") pod \"konnectivity-agent-bfrz4\" (UID: \"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2\") " pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.469970 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfbb11d2-706c-4ff3-990a-68c079514c2f-multus-conf-dir\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysctl-d\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.467989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0367236e-a57f-49d9-9920-4021b9417521-etc-openvswitch\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-socket-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-systemd\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-device-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-lib-modules\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc458265-638b-4f51-9181-c3bf720f0384-device-dir\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.468830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e35ae7a-aef8-4911-b663-b7089ce43cf8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.470532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.469289 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0367236e-a57f-49d9-9920-4021b9417521-ovn-node-metrics-cert\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.473530 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.473298 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:00.473530 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.473324 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:00.473530 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.473337 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:00.473530 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.473399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:49:00.97338144 +0000 UTC m=+3.002116337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:00.475855 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.475612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhs9\" (UniqueName: \"kubernetes.io/projected/0367236e-a57f-49d9-9920-4021b9417521-kube-api-access-glhs9\") pod \"ovnkube-node-c8svm\" (UID: \"0367236e-a57f-49d9-9920-4021b9417521\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.475960 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.475932 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89bx5\" (UniqueName: \"kubernetes.io/projected/1e35ae7a-aef8-4911-b663-b7089ce43cf8-kube-api-access-89bx5\") pod \"multus-additional-cni-plugins-whg7s\" (UID: \"1e35ae7a-aef8-4911-b663-b7089ce43cf8\") " pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.476362 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.476343 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv6k5\" (UniqueName: \"kubernetes.io/projected/a2dd61d5-af30-4a36-9e88-6bcc55877abd-kube-api-access-kv6k5\") pod \"iptables-alerter-fh2rc\" (UID: \"a2dd61d5-af30-4a36-9e88-6bcc55877abd\") " pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.476362 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.476349 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5t9\" (UniqueName: \"kubernetes.io/projected/bfbb11d2-706c-4ff3-990a-68c079514c2f-kube-api-access-zf5t9\") pod \"multus-k5gj6\" (UID: \"bfbb11d2-706c-4ff3-990a-68c079514c2f\") " pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.476541 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.476487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcr9l\" (UniqueName: \"kubernetes.io/projected/dc458265-638b-4f51-9181-c3bf720f0384-kube-api-access-zcr9l\") pod \"aws-ebs-csi-driver-node-nq7dm\" (UID: \"dc458265-638b-4f51-9181-c3bf720f0384\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.477305 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.477282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9cqm\" (UniqueName: \"kubernetes.io/projected/0afed098-ee13-41f5-a7d8-1c245a5127b7-kube-api-access-g9cqm\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.569327 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18478fc6-df84-4d19-922a-d1b7bb444bb6-host\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.569327 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmgl\" (UniqueName: \"kubernetes.io/projected/18478fc6-df84-4d19-922a-d1b7bb444bb6-kube-api-access-cdmgl\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.569550 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2-konnectivity-ca\") pod \"konnectivity-agent-bfrz4\" (UID: \"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2\") " pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.569550 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569422 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18478fc6-df84-4d19-922a-d1b7bb444bb6-host\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.569550 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-sys\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569550 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-modprobe-d\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569550 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-tmp-dir\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.569760 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-sys\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569760 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4wwf\" (UniqueName: \"kubernetes.io/projected/bf5bcd89-a970-4500-b305-9724b42454d0-kube-api-access-r4wwf\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569760 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-hosts-file\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.569760 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569693 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-modprobe-d\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569760 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2n5r\" (UniqueName: \"kubernetes.io/projected/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-kube-api-access-k2n5r\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-hosts-file\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18478fc6-df84-4d19-922a-d1b7bb444bb6-serviceca\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysconfig\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-host\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-tmp-dir\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf5bcd89-a970-4500-b305-9724b42454d0-tmp\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysctl-conf\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.569959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-run\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-host\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.569980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-var-lib-kubelet\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysconfig\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570038 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2-konnectivity-ca\") pod \"konnectivity-agent-bfrz4\" (UID: \"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2\") " pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570075 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-kubernetes\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570092 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysctl-conf\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-var-lib-kubelet\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-kubernetes\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570190 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-run\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18478fc6-df84-4d19-922a-d1b7bb444bb6-serviceca\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2-agent-certs\") pod \"konnectivity-agent-bfrz4\" (UID: \"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2\") " pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.570278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysctl-d\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-systemd\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-lib-modules\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-systemd\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf5bcd89-a970-4500-b305-9724b42454d0-etc-tuned\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-etc-sysctl-d\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.570758 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.570475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf5bcd89-a970-4500-b305-9724b42454d0-lib-modules\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.572599 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.572573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf5bcd89-a970-4500-b305-9724b42454d0-tmp\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.573202 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.573178 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2-agent-certs\") pod \"konnectivity-agent-bfrz4\" (UID: \"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2\") " pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.573441 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.573423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf5bcd89-a970-4500-b305-9724b42454d0-etc-tuned\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.578481 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.578446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4wwf\" (UniqueName: \"kubernetes.io/projected/bf5bcd89-a970-4500-b305-9724b42454d0-kube-api-access-r4wwf\") pod \"tuned-6jwxf\" (UID: \"bf5bcd89-a970-4500-b305-9724b42454d0\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.578836 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.578783 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmgl\" (UniqueName: \"kubernetes.io/projected/18478fc6-df84-4d19-922a-d1b7bb444bb6-kube-api-access-cdmgl\") pod \"node-ca-kmtjj\" (UID: \"18478fc6-df84-4d19-922a-d1b7bb444bb6\") " pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.579390 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.579368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2n5r\" (UniqueName: \"kubernetes.io/projected/5be06fc6-2689-4af7-9794-d16f5c8b4ba6-kube-api-access-k2n5r\") pod \"node-resolver-lf7vp\" (UID: \"5be06fc6-2689-4af7-9794-d16f5c8b4ba6\") " pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.652480 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.652450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:00.661047 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.660983 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-whg7s" Jun 05 17:49:00.668669 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.668641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5gj6" Jun 05 17:49:00.675491 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.675466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fh2rc" Jun 05 17:49:00.682047 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.682025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" Jun 05 17:49:00.688747 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.688725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:00.695401 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.695376 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" Jun 05 17:49:00.703097 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.703066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lf7vp" Jun 05 17:49:00.707621 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.707591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmtjj" Jun 05 17:49:00.973648 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.973555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:00.973648 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.973608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:00.973660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973737 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973789 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973809 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973815 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:01.973794326 +0000 UTC m=+4.002529228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973822 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:00.973845 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973749 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:00.974107 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973868 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:49:01.973857239 +0000 UTC m=+4.002592150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:00.974107 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:00.973919 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:01.973897336 +0000 UTC m=+4.002632248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:01.194116 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.194075 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be06fc6_2689_4af7_9794_d16f5c8b4ba6.slice/crio-a900d869233bad1dafb0551a70fdde236b209aea78fa8903681a649990ed66ae WatchSource:0}: Error finding container a900d869233bad1dafb0551a70fdde236b209aea78fa8903681a649990ed66ae: Status 404 returned error can't find the container with id a900d869233bad1dafb0551a70fdde236b209aea78fa8903681a649990ed66ae Jun 05 17:49:01.195203 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.195181 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18478fc6_df84_4d19_922a_d1b7bb444bb6.slice/crio-a5c9ee0cc780099357df5e5a153194a02d3803f4d23f02d90aa78b17e187e420 WatchSource:0}: Error finding container a5c9ee0cc780099357df5e5a153194a02d3803f4d23f02d90aa78b17e187e420: Status 404 returned error can't find the container with id a5c9ee0cc780099357df5e5a153194a02d3803f4d23f02d90aa78b17e187e420 Jun 05 17:49:01.196765 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.196646 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a350cb0_e2ff_41f0_8fc5_0f6993a1e1c2.slice/crio-142e349c957decb8d50f30d746935aec58a948f56cafdc27ece6ef608c42ae7f WatchSource:0}: Error finding container 142e349c957decb8d50f30d746935aec58a948f56cafdc27ece6ef608c42ae7f: Status 404 returned error can't find the container with id 142e349c957decb8d50f30d746935aec58a948f56cafdc27ece6ef608c42ae7f Jun 05 17:49:01.200678 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.200562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0367236e_a57f_49d9_9920_4021b9417521.slice/crio-ae67ab35e51329a5cc05d5cee144731fa1c9fb897bb7a61f7e4de1650243ee20 WatchSource:0}: Error finding container ae67ab35e51329a5cc05d5cee144731fa1c9fb897bb7a61f7e4de1650243ee20: Status 404 returned error can't find the container with id ae67ab35e51329a5cc05d5cee144731fa1c9fb897bb7a61f7e4de1650243ee20 Jun 05 17:49:01.202042 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.202023 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e35ae7a_aef8_4911_b663_b7089ce43cf8.slice/crio-377334b3062e57f9a266208614b1377d7f7a6143eb924dbe3f568e4bd8dda8a1 WatchSource:0}: Error finding container 377334b3062e57f9a266208614b1377d7f7a6143eb924dbe3f568e4bd8dda8a1: Status 404 returned error can't find the container with id 377334b3062e57f9a266208614b1377d7f7a6143eb924dbe3f568e4bd8dda8a1 Jun 05 17:49:01.203265 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.203238 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5bcd89_a970_4500_b305_9724b42454d0.slice/crio-729655d7ef57479e5b4c8c02c4140cdc1bf2428cca41a6b0d6006b94fdf7f43b WatchSource:0}: Error finding container 729655d7ef57479e5b4c8c02c4140cdc1bf2428cca41a6b0d6006b94fdf7f43b: Status 404 returned error can't find the container with id 729655d7ef57479e5b4c8c02c4140cdc1bf2428cca41a6b0d6006b94fdf7f43b Jun 05 17:49:01.206010 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.204963 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc458265_638b_4f51_9181_c3bf720f0384.slice/crio-1cceeb820915aa146fcb32db4972ca2f1f44f81215808d8e9d4bd8dc126cc665 WatchSource:0}: Error finding container 1cceeb820915aa146fcb32db4972ca2f1f44f81215808d8e9d4bd8dc126cc665: Status 404 returned error can't find the container with id 1cceeb820915aa146fcb32db4972ca2f1f44f81215808d8e9d4bd8dc126cc665 Jun 05 17:49:01.206197 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.206176 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2dd61d5_af30_4a36_9e88_6bcc55877abd.slice/crio-53825e8da9b47b59ad2ca06f9a56a18db30e31be83d431ed7393056053fc0e0e WatchSource:0}: Error finding container 53825e8da9b47b59ad2ca06f9a56a18db30e31be83d431ed7393056053fc0e0e: Status 404 returned error can't find the container with id 53825e8da9b47b59ad2ca06f9a56a18db30e31be83d431ed7393056053fc0e0e Jun 05 17:49:01.208825 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:01.208796 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbb11d2_706c_4ff3_990a_68c079514c2f.slice/crio-e70a5d968bdc7355c536b9abb95af662af2cd10e39d978a8431aba058c14dbe6 WatchSource:0}: Error finding container e70a5d968bdc7355c536b9abb95af662af2cd10e39d978a8431aba058c14dbe6: Status 404 returned error can't find the container with id e70a5d968bdc7355c536b9abb95af662af2cd10e39d978a8431aba058c14dbe6 Jun 05 17:49:01.388205 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.388108 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 17:44:00 +0000 UTC" deadline="2027-12-28 03:10:56.152323176 +0000 UTC" Jun 05 17:49:01.388205 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.388156 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13689h21m54.764170393s" Jun 05 17:49:01.428885 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.428852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" event={"ID":"59cbe8b5e51f41f49bc87ba9b229c8d4","Type":"ContainerStarted","Data":"206f973f1a2b0d331c1e1eb8102288668e683044e8922706aad4b6a76138cf1c"} Jun 05 17:49:01.429979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.429951 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5gj6" event={"ID":"bfbb11d2-706c-4ff3-990a-68c079514c2f","Type":"ContainerStarted","Data":"e70a5d968bdc7355c536b9abb95af662af2cd10e39d978a8431aba058c14dbe6"} Jun 05 17:49:01.430943 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.430921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fh2rc" event={"ID":"a2dd61d5-af30-4a36-9e88-6bcc55877abd","Type":"ContainerStarted","Data":"53825e8da9b47b59ad2ca06f9a56a18db30e31be83d431ed7393056053fc0e0e"} Jun 05 17:49:01.431907 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.431891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" event={"ID":"dc458265-638b-4f51-9181-c3bf720f0384","Type":"ContainerStarted","Data":"1cceeb820915aa146fcb32db4972ca2f1f44f81215808d8e9d4bd8dc126cc665"} Jun 05 17:49:01.432961 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.432922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" event={"ID":"bf5bcd89-a970-4500-b305-9724b42454d0","Type":"ContainerStarted","Data":"729655d7ef57479e5b4c8c02c4140cdc1bf2428cca41a6b0d6006b94fdf7f43b"} Jun 05 17:49:01.433956 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.433935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"ae67ab35e51329a5cc05d5cee144731fa1c9fb897bb7a61f7e4de1650243ee20"} Jun 05 17:49:01.435102 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.435085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfrz4" event={"ID":"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2","Type":"ContainerStarted","Data":"142e349c957decb8d50f30d746935aec58a948f56cafdc27ece6ef608c42ae7f"} Jun 05 17:49:01.436093 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.436072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerStarted","Data":"377334b3062e57f9a266208614b1377d7f7a6143eb924dbe3f568e4bd8dda8a1"} Jun 05 17:49:01.437099 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.437081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmtjj" event={"ID":"18478fc6-df84-4d19-922a-d1b7bb444bb6","Type":"ContainerStarted","Data":"a5c9ee0cc780099357df5e5a153194a02d3803f4d23f02d90aa78b17e187e420"} Jun 05 17:49:01.438187 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.438163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lf7vp" event={"ID":"5be06fc6-2689-4af7-9794-d16f5c8b4ba6","Type":"ContainerStarted","Data":"a900d869233bad1dafb0551a70fdde236b209aea78fa8903681a649990ed66ae"} Jun 05 17:49:01.982472 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.982433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:01.982696 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.982499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:01.982696 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:01.982535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:01.982696 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.982667 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:01.982866 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.982733 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:03.982712616 +0000 UTC m=+6.011447529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:01.983186 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.983161 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:01.983285 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.983227 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:03.98321147 +0000 UTC m=+6.011946367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:01.983352 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.983304 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:01.983352 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.983335 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:01.983352 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.983348 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:01.983546 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:01.983387 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:49:03.983373966 +0000 UTC m=+6.012108878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:02.388601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.388554 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 17:44:00 +0000 UTC" deadline="2028-01-13 22:31:02.520828743 +0000 UTC" Jun 05 17:49:02.388601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.388599 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14092h42m0.132234451s" Jun 05 17:49:02.423183 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.422665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:02.423183 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:02.422824 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:02.423183 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.422925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:02.423183 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:02.423033 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:02.423183 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.423095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:02.423183 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:02.423168 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:02.455553 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.454999 2579 generic.go:356] "Generic (PLEG): container finished" podID="716f94c0df12941e5969fa31f0453ce2" containerID="15e474d627ecd11a74eff26354fa3e24189251b06c768d384f26d68cdb714794" exitCode=0 Jun 05 17:49:02.455553 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.455102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" event={"ID":"716f94c0df12941e5969fa31f0453ce2","Type":"ContainerDied","Data":"15e474d627ecd11a74eff26354fa3e24189251b06c768d384f26d68cdb714794"} Jun 05 17:49:02.471335 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:02.471264 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-168.ec2.internal" podStartSLOduration=3.471242816 podStartE2EDuration="3.471242816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:01.444172412 +0000 UTC m=+3.472907328" watchObservedRunningTime="2026-06-05 17:49:02.471242816 +0000 UTC m=+4.499977736" Jun 05 17:49:03.482246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:03.480419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" event={"ID":"716f94c0df12941e5969fa31f0453ce2","Type":"ContainerStarted","Data":"5dadb6521c78e371d5334fb5e6c3ba093ff7492a8cfdaee18ad30ebc6bc46d58"} Jun 05 17:49:03.497507 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:03.496889 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-168.ec2.internal" podStartSLOduration=4.496869409 podStartE2EDuration="4.496869409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:03.49587223 +0000 UTC m=+5.524607152" watchObservedRunningTime="2026-06-05 17:49:03.496869409 +0000 UTC m=+5.525604330" Jun 05 17:49:04.000955 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:04.000915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:04.001140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:04.000986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:04.001140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:04.001022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:04.001253 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001157 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:04.001253 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001222 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:08.001202389 +0000 UTC m=+10.029937290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:04.001688 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001644 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:04.001835 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001703 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:08.001686791 +0000 UTC m=+10.030421691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:04.001835 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001788 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:04.001835 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001805 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:04.001835 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001818 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:04.002125 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.001853 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:49:08.001841816 +0000 UTC m=+10.030576717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:04.421057 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:04.421021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:04.421244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:04.421069 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:04.421244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:04.421021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:04.421244 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.421197 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:04.421595 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.421536 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:04.421731 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:04.421601 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:06.420761 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:06.420721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:06.421207 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:06.420739 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:06.421207 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:06.420863 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:06.421207 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:06.420923 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:06.421207 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:06.420739 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:06.421207 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:06.420998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:08.036743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:08.036812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:08.036866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037003 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037073 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:16.037051612 +0000 UTC m=+18.065786513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037518 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037539 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037552 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:49:16.037586456 +0000 UTC m=+18.066321437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037678 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:08.037753 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.037712 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:16.037700614 +0000 UTC m=+18.066435515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:08.421059 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:08.421025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:08.421221 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:08.421130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:08.421221 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:08.421174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:08.421221 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.421185 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:08.421352 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.421250 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:08.421352 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:08.421323 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:10.420993 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:10.420952 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:10.421429 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:10.420951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:10.421429 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:10.421098 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:10.421429 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:10.421184 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:10.421429 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:10.420956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:10.421429 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:10.421270 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:12.420702 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:12.420666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:12.421154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:12.420667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:12.421154 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:12.420820 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:12.421154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:12.420667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:12.421154 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:12.420939 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:12.421154 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:12.421030 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:14.420222 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:14.420183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:14.420667 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:14.420310 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:14.420667 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:14.420183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:14.420667 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:14.420460 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:14.420667 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:14.420192 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:14.420667 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:14.420604 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:16.101663 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:16.101596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:16.101692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:16.101736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101799 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101847 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101863 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101879 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101883 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:32.101860387 +0000 UTC m=+34.130595301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101892 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101910 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:32.101891719 +0000 UTC m=+34.130626635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:16.102126 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.101934 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:49:32.101921647 +0000 UTC m=+34.130656561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:16.420338 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:16.420290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:16.420338 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:16.420311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:16.420575 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:16.420311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:16.420575 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.420437 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:16.420575 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.420501 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:16.420743 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:16.420588 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:18.421646 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:18.421595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:18.422079 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:18.421713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:18.422079 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:18.421745 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:18.422079 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:18.421791 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:18.422079 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:18.421824 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:18.422079 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:18.421895 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:20.421170 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.420802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:20.422072 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.420802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:20.422072 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:20.421284 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:20.422072 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.420803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:20.422072 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:20.421351 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:20.422072 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:20.421394 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:20.516446 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.516353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lf7vp" event={"ID":"5be06fc6-2689-4af7-9794-d16f5c8b4ba6","Type":"ContainerStarted","Data":"9548f1c478d11c28c33fea4bd0542c81b48a31df75ffb21297ce91fb4dde911b"} Jun 05 17:49:20.517822 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.517791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5gj6" event={"ID":"bfbb11d2-706c-4ff3-990a-68c079514c2f","Type":"ContainerStarted","Data":"e5bc9055c88295e1f15943f0d59228e70d7bb873e4a1cb5bdfb86aa3a5472f81"} Jun 05 17:49:20.519303 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.519277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" event={"ID":"dc458265-638b-4f51-9181-c3bf720f0384","Type":"ContainerStarted","Data":"17bc9da533214d6f3d4d29b1ddf480e2c8f85a111bd22597f037d6451e4b42ce"} Jun 05 17:49:20.521349 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.521322 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" event={"ID":"bf5bcd89-a970-4500-b305-9724b42454d0","Type":"ContainerStarted","Data":"11e0f7ef8c43c889871b3b47736b01efce6b815008d6dd9cea1d2b1a91d32b6c"} Jun 05 17:49:20.524461 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.524434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"b11a84d29654b2dd38b9644b25b3e4db45a5daa597abf8238c512c9f0c834ec9"} Jun 05 17:49:20.524539 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.524511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"588b13a3f6c2c302ac7245bd6253b6fa009094634df1921fbe318bdc852341c5"} Jun 05 17:49:20.524589 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.524560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"d60c4f0cfd1bace33434eae03ccc03c81d459459e8c55142601047b3575e752f"} Jun 05 17:49:20.524641 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.524608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"8ea6d2f2c18614cf2b3b32bf29bcd23936ed0051732bc9a843d6a7aed740097f"} Jun 05 17:49:20.524747 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.524676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"68f5d05e27d9f34eac2d0f9e34ab1a4a7a16c80e9c14bab332fccc3d5d0f8b45"} Jun 05 17:49:20.524747 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.524707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"6abe1b6fdea768ec14720e1fb9aaca8066d49200006c627725a1336acdc5b3ac"} Jun 05 17:49:20.525815 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.525793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfrz4" event={"ID":"7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2","Type":"ContainerStarted","Data":"a1c1adb053b1d7b32a1aec737510b36037b74b2eab8549889db99a2dcebc3a01"} Jun 05 17:49:20.527253 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.527233 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e35ae7a-aef8-4911-b663-b7089ce43cf8" containerID="f541142426950bd462963b50a5dec8a02d4f8586a6924dbbfcc661cd3678af3f" exitCode=0 Jun 05 17:49:20.527338 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.527283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerDied","Data":"f541142426950bd462963b50a5dec8a02d4f8586a6924dbbfcc661cd3678af3f"} Jun 05 17:49:20.528807 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.528736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmtjj" event={"ID":"18478fc6-df84-4d19-922a-d1b7bb444bb6","Type":"ContainerStarted","Data":"05378409c243b5ea8b989663f8af2daeed3958acd6d247fd08758c35b935b0b9"} Jun 05 17:49:20.531601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.531562 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lf7vp" podStartSLOduration=3.968009655 podStartE2EDuration="22.531547422s" totalImagesPullingTime="18.563537767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:20.531011613 +0000 UTC m=+22.559746532" watchObservedRunningTime="2026-06-05 17:49:20.531547422 +0000 UTC m=+22.560282345" Jun 05 17:49:20.564778 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.564726 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6jwxf" podStartSLOduration=4.012849584 podStartE2EDuration="22.564710316s" totalImagesPullingTime="18.551860732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:20.548073633 +0000 UTC m=+22.576808570" watchObservedRunningTime="2026-06-05 17:49:20.564710316 +0000 UTC m=+22.593445270" Jun 05 17:49:20.565156 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.565126 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k5gj6" podStartSLOduration=3.975065214 podStartE2EDuration="22.565116927s" totalImagesPullingTime="18.590051713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:20.564349486 +0000 UTC m=+22.593084406" watchObservedRunningTime="2026-06-05 17:49:20.565116927 +0000 UTC m=+22.593851846" Jun 05 17:49:20.578930 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.578880 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bfrz4" podStartSLOduration=8.526685851 podStartE2EDuration="22.578864714s" totalImagesPullingTime="14.052178863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:20.578296841 +0000 UTC m=+22.607031762" watchObservedRunningTime="2026-06-05 17:49:20.578864714 +0000 UTC m=+22.607599635" Jun 05 17:49:20.595066 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.595004 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kmtjj" podStartSLOduration=4.049932494 podStartE2EDuration="22.59498398s" totalImagesPullingTime="18.545051486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:20.594060968 +0000 UTC m=+22.622795890" watchObservedRunningTime="2026-06-05 17:49:20.59498398 +0000 UTC m=+22.623718901" Jun 05 17:49:20.800352 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:20.800332 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 17:49:21.421849 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:21.421587 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T17:49:20.800347995Z","UUID":"bc2554d1-cb66-4bf3-8dc8-5e1b8935582a","Handler":null,"Name":"","Endpoint":""} Jun 05 17:49:21.423670 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:21.423597 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 17:49:21.423670 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:21.423673 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 17:49:21.532244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:21.532209 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fh2rc" event={"ID":"a2dd61d5-af30-4a36-9e88-6bcc55877abd","Type":"ContainerStarted","Data":"63e7f11d361b2f6f135d69cfe32734896a070e2daed2cbc99b4ed0e51fd3e70f"} Jun 05 17:49:21.534364 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:21.534292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" event={"ID":"dc458265-638b-4f51-9181-c3bf720f0384","Type":"ContainerStarted","Data":"bed7c67813717ab16dec5cccc3dc7ee53e6461c66ef1821479de6400c7fb524d"} Jun 05 17:49:21.546697 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:21.546642 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fh2rc" podStartSLOduration=4.997698556 podStartE2EDuration="23.546606779s" totalImagesPullingTime="18.548908223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:21.546399183 +0000 UTC m=+23.575134124" watchObservedRunningTime="2026-06-05 17:49:21.546606779 +0000 UTC m=+23.575341722" Jun 05 17:49:22.420507 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:22.420478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:22.420659 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:22.420480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:22.420659 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:22.420618 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:22.420659 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:22.420643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:22.420832 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:22.420739 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:22.420832 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:22.420822 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:22.539380 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:22.539345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" event={"ID":"dc458265-638b-4f51-9181-c3bf720f0384","Type":"ContainerStarted","Data":"12a5ce3d1f4e5062ed386c1e822898f5565cbea4fbb7fbb5a3acf8ee003174c5"} Jun 05 17:49:22.543038 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:22.543005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"ff9b93a35975b21ad565a078abe2ac8f911679ed3a9088a58a11d669c4316a3c"} Jun 05 17:49:22.559278 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:22.559223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nq7dm" podStartSLOduration=4.667253222 podStartE2EDuration="24.559204603s" totalImagesPullingTime="19.891951381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:22.559126151 +0000 UTC m=+24.587861072" watchObservedRunningTime="2026-06-05 17:49:22.559204603 +0000 UTC m=+24.587939540" Jun 05 17:49:23.673494 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:23.673454 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:23.674341 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:23.674316 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:24.420424 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:24.420384 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:24.420596 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:24.420385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:24.420596 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:24.420538 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:24.420752 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:24.420594 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:24.420752 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:24.420385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:24.420752 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:24.420709 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:24.548429 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:24.548399 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:24.548966 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:24.548947 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 17:49:25.553578 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.553373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" event={"ID":"0367236e-a57f-49d9-9920-4021b9417521","Type":"ContainerStarted","Data":"c4700e4a18b52ddf0a9d28e4d3e4248d54bb6dbfe0a8f392bf3a4ca3d42ff5fb"} Jun 05 17:49:25.555057 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.553826 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:25.555057 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.553904 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:25.555393 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.555370 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e35ae7a-aef8-4911-b663-b7089ce43cf8" containerID="d2f4d7b1e22ae8be4412645ca526a8f25500b5b475c97ce2c60a5c4e871255fb" exitCode=0 Jun 05 17:49:25.555474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.555452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerDied","Data":"d2f4d7b1e22ae8be4412645ca526a8f25500b5b475c97ce2c60a5c4e871255fb"} Jun 05 17:49:25.569126 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.569099 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:25.569255 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.569202 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:25.582617 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:25.582570 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" podStartSLOduration=8.938110069 podStartE2EDuration="27.582555928s" totalImagesPullingTime="18.644445859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:25.582222006 +0000 UTC m=+27.610956927" watchObservedRunningTime="2026-06-05 17:49:25.582555928 +0000 UTC m=+27.611290847" Jun 05 17:49:26.420502 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:26.420468 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:26.420717 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:26.420470 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:26.420717 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:26.420576 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:26.420717 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:26.420608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:26.420717 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:26.420700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:26.420930 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:26.420789 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:26.558541 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:26.558509 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 17:49:27.232395 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.232209 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pm5kp"] Jun 05 17:49:27.232573 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.232515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:27.232615 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:27.232599 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:27.235879 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.235846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh45g"] Jun 05 17:49:27.236029 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.235977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:27.236117 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:27.236090 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:27.236592 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.236571 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wg6ld"] Jun 05 17:49:27.236710 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.236679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:27.236765 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:27.236742 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:27.562702 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.562670 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e35ae7a-aef8-4911-b663-b7089ce43cf8" containerID="71fc796f4bd7cfbe1c1260c5bf2433445a4b395e329dc5002c7a8efcb8b5be03" exitCode=0 Jun 05 17:49:27.563145 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.562751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerDied","Data":"71fc796f4bd7cfbe1c1260c5bf2433445a4b395e329dc5002c7a8efcb8b5be03"} Jun 05 17:49:27.563145 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.562820 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 17:49:27.792882 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:27.792851 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:49:28.421244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:28.421213 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:28.421441 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:28.421306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:28.421441 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:28.421336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:28.421441 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:28.421359 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:28.421441 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:28.421412 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:28.421658 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:28.421500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:29.569752 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:29.569664 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e35ae7a-aef8-4911-b663-b7089ce43cf8" containerID="b812a4b821b00d8cb7c33c28265dd17cdb489ec11c558646ee1aec0f777bfd55" exitCode=0 Jun 05 17:49:29.569752 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:29.569707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerDied","Data":"b812a4b821b00d8cb7c33c28265dd17cdb489ec11c558646ee1aec0f777bfd55"} Jun 05 17:49:30.420092 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:30.420059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:30.420284 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:30.420059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:30.420284 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:30.420166 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:30.420284 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:30.420244 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:30.420284 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:30.420059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:30.420501 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:30.420365 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:32.125355 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.125164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:32.125355 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125348 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125375 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.125379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.125450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125388 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kd5tn for pod openshift-network-diagnostics/network-check-target-wg6ld: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125528 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn podName:a6618a6c-a1c7-4c4c-b80a-41adceabf43f nodeName:}" failed. No retries permitted until 2026-06-05 17:50:04.12550628 +0000 UTC m=+66.154241191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kd5tn" (UniqueName: "kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn") pod "network-check-target-wg6ld" (UID: "a6618a6c-a1c7-4c4c-b80a-41adceabf43f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125546 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125547 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125600 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:04.12558242 +0000 UTC m=+66.154317323 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:32.125917 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.125668 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret podName:4ba16dce-991c-4df2-813e-cfb32a7c2434 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:04.125648316 +0000 UTC m=+66.154383227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret") pod "global-pull-secret-syncer-pm5kp" (UID: "4ba16dce-991c-4df2-813e-cfb32a7c2434") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:32.420742 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.420613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:32.420742 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.420683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:32.420959 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.420758 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg6ld" podUID="a6618a6c-a1c7-4c4c-b80a-41adceabf43f" Jun 05 17:49:32.420959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.420613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:32.420959 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.420895 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:49:32.421098 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:32.420978 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pm5kp" podUID="4ba16dce-991c-4df2-813e-cfb32a7c2434" Jun 05 17:49:32.805533 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.805455 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-168.ec2.internal" event="NodeReady" Jun 05 17:49:32.805719 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.805617 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 17:49:32.849802 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.849768 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-79sgg"] Jun 05 17:49:32.878299 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.878269 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cc2cg"] Jun 05 17:49:32.878479 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.878422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:32.881246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.881108 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 17:49:32.881396 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.881291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 17:49:32.881466 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.881392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4cc\"" Jun 05 17:49:32.894252 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.894228 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79sgg"] Jun 05 17:49:32.894384 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.894272 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc2cg"] Jun 05 17:49:32.895081 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.894385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:32.896956 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.896932 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 17:49:32.897072 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.897006 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 17:49:32.897072 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.897034 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 17:49:32.897187 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:32.897013 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwlsz\"" Jun 05 17:49:33.033118 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.033083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.033288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.033129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bcf959c-c68e-4a11-9d52-ca73208273b2-config-volume\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.033288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.033156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbs9\" (UniqueName: \"kubernetes.io/projected/2bcf959c-c68e-4a11-9d52-ca73208273b2-kube-api-access-2kbs9\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.033288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.033193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcf959c-c68e-4a11-9d52-ca73208273b2-tmp-dir\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.033288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.033220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82cd66c7-5022-43c7-9f2e-493580bc9c9b-cert\") pod \"ingress-canary-cc2cg\" (UID: \"82cd66c7-5022-43c7-9f2e-493580bc9c9b\") " pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.033288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.033255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rd6j\" (UniqueName: \"kubernetes.io/projected/82cd66c7-5022-43c7-9f2e-493580bc9c9b-kube-api-access-7rd6j\") pod \"ingress-canary-cc2cg\" (UID: \"82cd66c7-5022-43c7-9f2e-493580bc9c9b\") " pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.134437 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bcf959c-c68e-4a11-9d52-ca73208273b2-config-volume\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbs9\" (UniqueName: \"kubernetes.io/projected/2bcf959c-c68e-4a11-9d52-ca73208273b2-kube-api-access-2kbs9\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcf959c-c68e-4a11-9d52-ca73208273b2-tmp-dir\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82cd66c7-5022-43c7-9f2e-493580bc9c9b-cert\") pod \"ingress-canary-cc2cg\" (UID: \"82cd66c7-5022-43c7-9f2e-493580bc9c9b\") " pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rd6j\" (UniqueName: \"kubernetes.io/projected/82cd66c7-5022-43c7-9f2e-493580bc9c9b-kube-api-access-7rd6j\") pod \"ingress-canary-cc2cg\" (UID: \"82cd66c7-5022-43c7-9f2e-493580bc9c9b\") " pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:33.134598 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:33.134971 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:33.134693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:33.634667626 +0000 UTC m=+35.663402541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:49:33.135313 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.134989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcf959c-c68e-4a11-9d52-ca73208273b2-tmp-dir\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.135313 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.135208 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bcf959c-c68e-4a11-9d52-ca73208273b2-config-volume\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.139298 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.139273 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82cd66c7-5022-43c7-9f2e-493580bc9c9b-cert\") pod \"ingress-canary-cc2cg\" (UID: \"82cd66c7-5022-43c7-9f2e-493580bc9c9b\") " pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.143535 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.143503 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbs9\" (UniqueName: \"kubernetes.io/projected/2bcf959c-c68e-4a11-9d52-ca73208273b2-kube-api-access-2kbs9\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.143724 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.143619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rd6j\" (UniqueName: \"kubernetes.io/projected/82cd66c7-5022-43c7-9f2e-493580bc9c9b-kube-api-access-7rd6j\") pod \"ingress-canary-cc2cg\" (UID: \"82cd66c7-5022-43c7-9f2e-493580bc9c9b\") " pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.204656 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.204607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc2cg" Jun 05 17:49:33.638578 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.638538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:33.638757 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:33.638717 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:33.638807 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:33.638800 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:34.638782281 +0000 UTC m=+36.667517178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:49:33.726125 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:33.726091 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc2cg"] Jun 05 17:49:33.729977 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:49:33.729953 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cd66c7_5022_43c7_9f2e_493580bc9c9b.slice/crio-109bcf1a1430539c8c867142513a8a4a4cd9959407ba4a72cf8c6a166d0e3bde WatchSource:0}: Error finding container 109bcf1a1430539c8c867142513a8a4a4cd9959407ba4a72cf8c6a166d0e3bde: Status 404 returned error can't find the container with id 109bcf1a1430539c8c867142513a8a4a4cd9959407ba4a72cf8c6a166d0e3bde Jun 05 17:49:34.420669 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.420617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:49:34.421131 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.420617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:49:34.421131 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.420635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:49:34.423727 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.423701 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 17:49:34.424813 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.424788 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42j2w\"" Jun 05 17:49:34.424936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.424812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9z2b\"" Jun 05 17:49:34.424936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.424839 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 17:49:34.424936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.424852 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 17:49:34.424936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.424792 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 17:49:34.586155 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.586111 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e35ae7a-aef8-4911-b663-b7089ce43cf8" containerID="bd5ef89240573557450f8977d2266e841278bef8a7a9718620a645a12773bd38" exitCode=0 Jun 05 17:49:34.586332 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.586174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerDied","Data":"bd5ef89240573557450f8977d2266e841278bef8a7a9718620a645a12773bd38"} Jun 05 17:49:34.587474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.587411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc2cg" event={"ID":"82cd66c7-5022-43c7-9f2e-493580bc9c9b","Type":"ContainerStarted","Data":"109bcf1a1430539c8c867142513a8a4a4cd9959407ba4a72cf8c6a166d0e3bde"} Jun 05 17:49:34.646916 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:34.646879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:34.647128 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:34.647110 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:34.647200 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:34.647183 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:36.64716109 +0000 UTC m=+38.675896011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:49:35.593788 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:35.593744 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e35ae7a-aef8-4911-b663-b7089ce43cf8" containerID="c4d479dedc1a6384c927ec8cf985e7d2d31bfdf513ef7482af23788f03ae6c90" exitCode=0 Jun 05 17:49:35.594246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:35.593810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerDied","Data":"c4d479dedc1a6384c927ec8cf985e7d2d31bfdf513ef7482af23788f03ae6c90"} Jun 05 17:49:36.600005 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:36.599913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whg7s" event={"ID":"1e35ae7a-aef8-4911-b663-b7089ce43cf8","Type":"ContainerStarted","Data":"3a432c77b055ee79a8d86155dda17761ea4f95a145fce3283d8744edbe5bc0ad"} Jun 05 17:49:36.601453 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:36.601426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc2cg" event={"ID":"82cd66c7-5022-43c7-9f2e-493580bc9c9b","Type":"ContainerStarted","Data":"67b18a5d408bbc97e0f43805be9f51f4cc653017f099a5f138a60b9e71053aac"} Jun 05 17:49:36.625134 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:36.625073 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-whg7s" podStartSLOduration=8.816217407 podStartE2EDuration="38.625052165s" totalImagesPullingTime="29.808834758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:36.623657684 +0000 UTC m=+38.652392605" watchObservedRunningTime="2026-06-05 17:49:36.625052165 +0000 UTC m=+38.653787086" Jun 05 17:49:36.639701 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:36.639652 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cc2cg" podStartSLOduration=2.3006459169999998 podStartE2EDuration="4.639621018s" totalImagesPullingTime="2.338975101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:36.639169797 +0000 UTC m=+38.667904722" watchObservedRunningTime="2026-06-05 17:49:36.639621018 +0000 UTC m=+38.668355977" Jun 05 17:49:36.663460 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:36.663427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:36.663619 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:36.663602 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:36.663717 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:36.663691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:40.663671041 +0000 UTC m=+42.692405956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:49:40.693192 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:40.693149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:40.693717 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:40.693276 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:40.693717 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:40.693330 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:48.693316863 +0000 UTC m=+50.722051761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:49:48.751336 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:48.751290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:49:48.751878 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:48.751449 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:48.751878 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:49:48.751519 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:04.75150202 +0000 UTC m=+66.780236952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:49:58.575330 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:49:58.575300 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8svm" Jun 05 17:50:00.725146 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.725106 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj"] Jun 05 17:50:00.730140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.730116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:00.732683 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.732648 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 17:50:00.733597 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.733579 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-849gn\"" Jun 05 17:50:00.733788 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.733615 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 17:50:00.733788 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.733702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 05 17:50:00.733788 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.733714 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 17:50:00.738081 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.738058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj"] Jun 05 17:50:00.748046 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.748025 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw"] Jun 05 17:50:00.749827 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.749807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.752352 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.752329 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 05 17:50:00.752471 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.752381 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 05 17:50:00.752471 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.752390 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 05 17:50:00.752471 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.752391 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 05 17:50:00.762443 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.762423 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw"] Jun 05 17:50:00.830776 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.830991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.830991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/633d56db-2dd1-4ade-9869-ff7172145d6e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.830991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkkc6\" (UniqueName: \"kubernetes.io/projected/6fd02ebd-b589-4265-a76c-ad4c84c96029-kube-api-access-rkkc6\") pod \"managed-serviceaccount-addon-agent-57bbd6b958-wzdvj\" (UID: \"6fd02ebd-b589-4265-a76c-ad4c84c96029\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:00.830991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5sz\" (UniqueName: \"kubernetes.io/projected/633d56db-2dd1-4ade-9869-ff7172145d6e-kube-api-access-sd5sz\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.830991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6fd02ebd-b589-4265-a76c-ad4c84c96029-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57bbd6b958-wzdvj\" (UID: \"6fd02ebd-b589-4265-a76c-ad4c84c96029\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:00.830991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-ca\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.831195 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.830995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-hub\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.932186 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.932287 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.932287 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/633d56db-2dd1-4ade-9869-ff7172145d6e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.932287 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkkc6\" (UniqueName: \"kubernetes.io/projected/6fd02ebd-b589-4265-a76c-ad4c84c96029-kube-api-access-rkkc6\") pod \"managed-serviceaccount-addon-agent-57bbd6b958-wzdvj\" (UID: \"6fd02ebd-b589-4265-a76c-ad4c84c96029\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:00.932287 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5sz\" (UniqueName: \"kubernetes.io/projected/633d56db-2dd1-4ade-9869-ff7172145d6e-kube-api-access-sd5sz\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.932471 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6fd02ebd-b589-4265-a76c-ad4c84c96029-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57bbd6b958-wzdvj\" (UID: \"6fd02ebd-b589-4265-a76c-ad4c84c96029\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:00.932471 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-ca\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.932471 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.932407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-hub\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.933784 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.933598 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/633d56db-2dd1-4ade-9869-ff7172145d6e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.936643 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.936592 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.936763 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.936616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-hub\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.936763 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.936595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-ca\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.939403 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.939378 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/633d56db-2dd1-4ade-9869-ff7172145d6e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.939670 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.939645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6fd02ebd-b589-4265-a76c-ad4c84c96029-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57bbd6b958-wzdvj\" (UID: \"6fd02ebd-b589-4265-a76c-ad4c84c96029\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:00.941373 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.941343 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5sz\" (UniqueName: \"kubernetes.io/projected/633d56db-2dd1-4ade-9869-ff7172145d6e-kube-api-access-sd5sz\") pod \"cluster-proxy-proxy-agent-5bdc764dcd-r6dkw\" (UID: \"633d56db-2dd1-4ade-9869-ff7172145d6e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:00.941459 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:00.941421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkkc6\" (UniqueName: \"kubernetes.io/projected/6fd02ebd-b589-4265-a76c-ad4c84c96029-kube-api-access-rkkc6\") pod \"managed-serviceaccount-addon-agent-57bbd6b958-wzdvj\" (UID: \"6fd02ebd-b589-4265-a76c-ad4c84c96029\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:01.051100 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:01.050990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" Jun 05 17:50:01.058433 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:01.058411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:50:01.201039 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:01.201007 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj"] Jun 05 17:50:01.205754 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:50:01.205722 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fd02ebd_b589_4265_a76c_ad4c84c96029.slice/crio-17a98892f2d53cb95ebc0728692407b3d16bb7efe6a1e054ef6efeae2f5b73b5 WatchSource:0}: Error finding container 17a98892f2d53cb95ebc0728692407b3d16bb7efe6a1e054ef6efeae2f5b73b5: Status 404 returned error can't find the container with id 17a98892f2d53cb95ebc0728692407b3d16bb7efe6a1e054ef6efeae2f5b73b5 Jun 05 17:50:01.217334 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:01.217310 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw"] Jun 05 17:50:01.220790 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:50:01.220762 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod633d56db_2dd1_4ade_9869_ff7172145d6e.slice/crio-fd29ac622733cc17b295bbf6677510ded6bfa382dc19571ac5bd4782952d708c WatchSource:0}: Error finding container fd29ac622733cc17b295bbf6677510ded6bfa382dc19571ac5bd4782952d708c: Status 404 returned error can't find the container with id fd29ac622733cc17b295bbf6677510ded6bfa382dc19571ac5bd4782952d708c Jun 05 17:50:01.666861 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:01.666823 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" event={"ID":"633d56db-2dd1-4ade-9869-ff7172145d6e","Type":"ContainerStarted","Data":"fd29ac622733cc17b295bbf6677510ded6bfa382dc19571ac5bd4782952d708c"} Jun 05 17:50:01.667884 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:01.667858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" event={"ID":"6fd02ebd-b589-4265-a76c-ad4c84c96029","Type":"ContainerStarted","Data":"17a98892f2d53cb95ebc0728692407b3d16bb7efe6a1e054ef6efeae2f5b73b5"} Jun 05 17:50:04.162357 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.162318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:50:04.162857 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.162380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:50:04.162857 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.162457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:50:04.165846 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.165809 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 17:50:04.165990 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.165965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 17:50:04.166140 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.166123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 17:50:04.173194 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:50:04.173171 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 17:50:04.173306 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:50:04.173247 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:51:08.173226714 +0000 UTC m=+130.201961613 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : secret "metrics-daemon-secret" not found Jun 05 17:50:04.175614 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.175590 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 17:50:04.176460 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.176433 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ba16dce-991c-4df2-813e-cfb32a7c2434-original-pull-secret\") pod \"global-pull-secret-syncer-pm5kp\" (UID: \"4ba16dce-991c-4df2-813e-cfb32a7c2434\") " pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:50:04.186849 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.186794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd5tn\" (UniqueName: \"kubernetes.io/projected/a6618a6c-a1c7-4c4c-b80a-41adceabf43f-kube-api-access-kd5tn\") pod \"network-check-target-wg6ld\" (UID: \"a6618a6c-a1c7-4c4c-b80a-41adceabf43f\") " pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:50:04.435992 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.435911 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9z2b\"" Jun 05 17:50:04.439485 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.439457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pm5kp" Jun 05 17:50:04.443603 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.443565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:50:04.625937 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.625908 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pm5kp"] Jun 05 17:50:04.646216 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.646133 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wg6ld"] Jun 05 17:50:04.678756 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.678714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" event={"ID":"6fd02ebd-b589-4265-a76c-ad4c84c96029","Type":"ContainerStarted","Data":"f1a7c6b31df81cfe08360fba6b1bef887218b1d0edafd71292fbf05022090f70"} Jun 05 17:50:04.694917 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.694808 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" podStartSLOduration=1.4207406439999999 podStartE2EDuration="4.694785865s" totalImagesPullingTime="3.274045221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:04.694329727 +0000 UTC m=+66.723064649" watchObservedRunningTime="2026-06-05 17:50:04.694785865 +0000 UTC m=+66.723520785" Jun 05 17:50:04.767742 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:04.767691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:50:04.767925 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:50:04.767859 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:50:04.768003 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:50:04.767944 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:36.767922135 +0000 UTC m=+98.796657049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:50:05.709798 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:50:05.709760 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba16dce_991c_4df2_813e_cfb32a7c2434.slice/crio-d6dd595e4a8b2be84ff35f29e000e795fd7f5fe67b9e6699a4ba14c3e069bf20 WatchSource:0}: Error finding container d6dd595e4a8b2be84ff35f29e000e795fd7f5fe67b9e6699a4ba14c3e069bf20: Status 404 returned error can't find the container with id d6dd595e4a8b2be84ff35f29e000e795fd7f5fe67b9e6699a4ba14c3e069bf20 Jun 05 17:50:05.710464 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:50:05.710255 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6618a6c_a1c7_4c4c_b80a_41adceabf43f.slice/crio-d77704bcd97aa082d889114493cf82c8d723131e7b8ae7f7acf140562586b18f WatchSource:0}: Error finding container d77704bcd97aa082d889114493cf82c8d723131e7b8ae7f7acf140562586b18f: Status 404 returned error can't find the container with id d77704bcd97aa082d889114493cf82c8d723131e7b8ae7f7acf140562586b18f Jun 05 17:50:06.687269 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:06.687123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pm5kp" event={"ID":"4ba16dce-991c-4df2-813e-cfb32a7c2434","Type":"ContainerStarted","Data":"d6dd595e4a8b2be84ff35f29e000e795fd7f5fe67b9e6699a4ba14c3e069bf20"} Jun 05 17:50:06.688959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:06.688921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wg6ld" event={"ID":"a6618a6c-a1c7-4c4c-b80a-41adceabf43f","Type":"ContainerStarted","Data":"d77704bcd97aa082d889114493cf82c8d723131e7b8ae7f7acf140562586b18f"} Jun 05 17:50:06.691559 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:06.691516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" event={"ID":"633d56db-2dd1-4ade-9869-ff7172145d6e","Type":"ContainerStarted","Data":"2c3bab8fdd09e08646052a60e478d018eae2e8ff2bcd2192e39a948cc1acbc76"} Jun 05 17:50:06.691695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:06.691563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" event={"ID":"633d56db-2dd1-4ade-9869-ff7172145d6e","Type":"ContainerStarted","Data":"dad922624a4ccd5763828b29f7ae7927ded16f3d38c71b5c2912256c46ff8999"} Jun 05 17:50:06.691695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:06.691653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" event={"ID":"633d56db-2dd1-4ade-9869-ff7172145d6e","Type":"ContainerStarted","Data":"a338ee0b8924d172498311ab4f3679a528427ce40e9a387ae96e20ba8a8e6c20"} Jun 05 17:50:06.712878 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:06.712805 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" podStartSLOduration=2.187678847 podStartE2EDuration="6.71278237s" totalImagesPullingTime="4.525103523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:06.712351911 +0000 UTC m=+68.741086831" watchObservedRunningTime="2026-06-05 17:50:06.71278237 +0000 UTC m=+68.741517309" Jun 05 17:50:10.704833 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:10.704791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pm5kp" event={"ID":"4ba16dce-991c-4df2-813e-cfb32a7c2434","Type":"ContainerStarted","Data":"512c5a40bce1f84c0ed5c9c1684217b92054c23475eb05641d877aef87d5e091"} Jun 05 17:50:10.706294 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:10.706265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wg6ld" event={"ID":"a6618a6c-a1c7-4c4c-b80a-41adceabf43f","Type":"ContainerStarted","Data":"f68c972569d6213afd90ec1aa7e1dd11e20f98146b08df81489f49847b0d842f"} Jun 05 17:50:10.706401 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:10.706390 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:50:10.739836 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:10.739781 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pm5kp" podStartSLOduration=68.443055206 podStartE2EDuration="1m12.739764297s" totalImagesPullingTime="4.296709091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:10.725010422 +0000 UTC m=+72.753745342" watchObservedRunningTime="2026-06-05 17:50:10.739764297 +0000 UTC m=+72.768499256" Jun 05 17:50:10.739999 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:10.739908 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wg6ld" podStartSLOduration=68.44851977 podStartE2EDuration="1m12.739901343s" totalImagesPullingTime="4.291381573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:10.738969495 +0000 UTC m=+72.767704416" watchObservedRunningTime="2026-06-05 17:50:10.739901343 +0000 UTC m=+72.768636263" Jun 05 17:50:36.800173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:36.800112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:50:36.800679 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:50:36.800266 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:50:36.800679 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:50:36.800332 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:51:40.800315973 +0000 UTC m=+162.829050876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:50:41.712512 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:50:41.712477 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wg6ld" Jun 05 17:51:08.219299 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:51:08.219244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:51:08.219824 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:51:08.219381 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 17:51:08.219824 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:51:08.219439 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs podName:0afed098-ee13-41f5-a7d8-1c245a5127b7 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:10.219423419 +0000 UTC m=+252.248158316 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs") pod "network-metrics-daemon-gh45g" (UID: "0afed098-ee13-41f5-a7d8-1c245a5127b7") : secret "metrics-daemon-secret" not found Jun 05 17:51:35.889305 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:51:35.889256 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-79sgg" podUID="2bcf959c-c68e-4a11-9d52-ca73208273b2" Jun 05 17:51:35.950925 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:51:35.950892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79sgg" Jun 05 17:51:37.445426 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:51:37.445384 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gh45g" podUID="0afed098-ee13-41f5-a7d8-1c245a5127b7" Jun 05 17:51:40.848168 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:51:40.848124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:51:40.848578 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:51:40.848281 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:51:40.848578 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:51:40.848347 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls podName:2bcf959c-c68e-4a11-9d52-ca73208273b2 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:42.848331367 +0000 UTC m=+284.877066265 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls") pod "dns-default-79sgg" (UID: "2bcf959c-c68e-4a11-9d52-ca73208273b2") : secret "dns-default-metrics-tls" not found Jun 05 17:51:51.420303 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:51:51.420264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:52:05.032431 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:05.032326 2579 generic.go:356] "Generic (PLEG): container finished" podID="6fd02ebd-b589-4265-a76c-ad4c84c96029" containerID="f1a7c6b31df81cfe08360fba6b1bef887218b1d0edafd71292fbf05022090f70" exitCode=255 Jun 05 17:52:05.032431 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:05.032404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" event={"ID":"6fd02ebd-b589-4265-a76c-ad4c84c96029","Type":"ContainerDied","Data":"f1a7c6b31df81cfe08360fba6b1bef887218b1d0edafd71292fbf05022090f70"} Jun 05 17:52:05.032866 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:05.032742 2579 scope.go:117] "RemoveContainer" containerID="f1a7c6b31df81cfe08360fba6b1bef887218b1d0edafd71292fbf05022090f70" Jun 05 17:52:06.037052 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:06.037019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57bbd6b958-wzdvj" event={"ID":"6fd02ebd-b589-4265-a76c-ad4c84c96029","Type":"ContainerStarted","Data":"f24b602eef3dacfdc5476e81c4e99408288278d5f5bf6c320fa15f880ce6bef0"} Jun 05 17:52:43.541284 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:43.541252 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lf7vp_5be06fc6-2689-4af7-9794-d16f5c8b4ba6/dns-node-resolver/0.log" Jun 05 17:52:44.741371 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:44.741342 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmtjj_18478fc6-df84-4d19-922a-d1b7bb444bb6/node-ca/0.log" Jun 05 17:52:45.341510 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:45.341476 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc2cg_82cd66c7-5022-43c7-9f2e-493580bc9c9b/serve-healthcheck-canary/0.log" Jun 05 17:52:51.060067 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:52:51.060020 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" podUID="633d56db-2dd1-4ade-9869-ff7172145d6e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 17:53:01.059808 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:01.059764 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" podUID="633d56db-2dd1-4ade-9869-ff7172145d6e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 17:53:05.791586 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.791552 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dtkmr"] Jun 05 17:53:05.794487 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.794464 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.797915 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.797890 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 17:53:05.798022 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.797949 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 17:53:05.798944 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.798921 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 17:53:05.799056 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.799009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 17:53:05.799056 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.799029 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mz8gr\"" Jun 05 17:53:05.861137 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.861105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0108c223-738c-48f8-8544-6189d9f7cb65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.861137 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.861139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0108c223-738c-48f8-8544-6189d9f7cb65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.861383 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.861210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0108c223-738c-48f8-8544-6189d9f7cb65-crio-socket\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.861383 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.861256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gvzr\" (UniqueName: \"kubernetes.io/projected/0108c223-738c-48f8-8544-6189d9f7cb65-kube-api-access-4gvzr\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.861383 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.861292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0108c223-738c-48f8-8544-6189d9f7cb65-data-volume\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.868898 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.868869 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dtkmr"] Jun 05 17:53:05.962097 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0108c223-738c-48f8-8544-6189d9f7cb65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962097 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0108c223-738c-48f8-8544-6189d9f7cb65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962362 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0108c223-738c-48f8-8544-6189d9f7cb65-crio-socket\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962362 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gvzr\" (UniqueName: \"kubernetes.io/projected/0108c223-738c-48f8-8544-6189d9f7cb65-kube-api-access-4gvzr\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962362 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0108c223-738c-48f8-8544-6189d9f7cb65-data-volume\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962362 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0108c223-738c-48f8-8544-6189d9f7cb65-crio-socket\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962568 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0108c223-738c-48f8-8544-6189d9f7cb65-data-volume\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.962761 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.962743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0108c223-738c-48f8-8544-6189d9f7cb65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.964480 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.964461 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0108c223-738c-48f8-8544-6189d9f7cb65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:05.971124 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:05.971101 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gvzr\" (UniqueName: \"kubernetes.io/projected/0108c223-738c-48f8-8544-6189d9f7cb65-kube-api-access-4gvzr\") pod \"insights-runtime-extractor-dtkmr\" (UID: \"0108c223-738c-48f8-8544-6189d9f7cb65\") " pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:06.103020 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:06.102930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dtkmr" Jun 05 17:53:06.226906 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:06.226875 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dtkmr"] Jun 05 17:53:06.229960 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:06.229930 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0108c223_738c_48f8_8544_6189d9f7cb65.slice/crio-ce35e5910a8835feca3f11827e495f62df1f50f0daac695810a4cbba2773eff0 WatchSource:0}: Error finding container ce35e5910a8835feca3f11827e495f62df1f50f0daac695810a4cbba2773eff0: Status 404 returned error can't find the container with id ce35e5910a8835feca3f11827e495f62df1f50f0daac695810a4cbba2773eff0 Jun 05 17:53:07.213327 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:07.213236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtkmr" event={"ID":"0108c223-738c-48f8-8544-6189d9f7cb65","Type":"ContainerStarted","Data":"37e17393d2ac4d992449ba1a1f324a771d55fa2fc791de8dd8a240d78c09da8a"} Jun 05 17:53:07.213694 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:07.213328 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtkmr" event={"ID":"0108c223-738c-48f8-8544-6189d9f7cb65","Type":"ContainerStarted","Data":"54cb9909cbe59dace4d592ab261dcab518646e3c80278f4853c6b528b249b110"} Jun 05 17:53:07.213694 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:07.213349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtkmr" event={"ID":"0108c223-738c-48f8-8544-6189d9f7cb65","Type":"ContainerStarted","Data":"ce35e5910a8835feca3f11827e495f62df1f50f0daac695810a4cbba2773eff0"} Jun 05 17:53:09.221613 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:09.221579 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtkmr" event={"ID":"0108c223-738c-48f8-8544-6189d9f7cb65","Type":"ContainerStarted","Data":"6cc537f77fa4bbe23cc70f9bcfbba71b628ca89822e38efdec536c526155c1da"} Jun 05 17:53:09.242019 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:09.241976 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dtkmr" podStartSLOduration=2.077339124 podStartE2EDuration="4.241961288s" totalImagesPullingTime="2.164622164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:53:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:09.241202185 +0000 UTC m=+251.269937106" watchObservedRunningTime="2026-06-05 17:53:09.241961288 +0000 UTC m=+251.270696207" Jun 05 17:53:10.290732 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:10.290695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:53:10.292929 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:10.292902 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afed098-ee13-41f5-a7d8-1c245a5127b7-metrics-certs\") pod \"network-metrics-daemon-gh45g\" (UID: \"0afed098-ee13-41f5-a7d8-1c245a5127b7\") " pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:53:10.323834 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:10.323812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42j2w\"" Jun 05 17:53:10.331119 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:10.331097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh45g" Jun 05 17:53:10.457155 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:10.457121 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh45g"] Jun 05 17:53:10.460807 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:10.460780 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afed098_ee13_41f5_a7d8_1c245a5127b7.slice/crio-fca124c9af8d878e8a04f90c04e3b938a81ef4e79098b7bed2889b4290c1b915 WatchSource:0}: Error finding container fca124c9af8d878e8a04f90c04e3b938a81ef4e79098b7bed2889b4290c1b915: Status 404 returned error can't find the container with id fca124c9af8d878e8a04f90c04e3b938a81ef4e79098b7bed2889b4290c1b915 Jun 05 17:53:11.060368 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.060325 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" podUID="633d56db-2dd1-4ade-9869-ff7172145d6e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 17:53:11.060527 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.060402 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" Jun 05 17:53:11.060986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.060951 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2c3bab8fdd09e08646052a60e478d018eae2e8ff2bcd2192e39a948cc1acbc76"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 05 17:53:11.061086 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.061010 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" podUID="633d56db-2dd1-4ade-9869-ff7172145d6e" containerName="service-proxy" containerID="cri-o://2c3bab8fdd09e08646052a60e478d018eae2e8ff2bcd2192e39a948cc1acbc76" gracePeriod=30 Jun 05 17:53:11.229526 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.229484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh45g" event={"ID":"0afed098-ee13-41f5-a7d8-1c245a5127b7","Type":"ContainerStarted","Data":"fca124c9af8d878e8a04f90c04e3b938a81ef4e79098b7bed2889b4290c1b915"} Jun 05 17:53:11.231791 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.231763 2579 generic.go:356] "Generic (PLEG): container finished" podID="633d56db-2dd1-4ade-9869-ff7172145d6e" containerID="2c3bab8fdd09e08646052a60e478d018eae2e8ff2bcd2192e39a948cc1acbc76" exitCode=2 Jun 05 17:53:11.231921 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:11.231816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" event={"ID":"633d56db-2dd1-4ade-9869-ff7172145d6e","Type":"ContainerDied","Data":"2c3bab8fdd09e08646052a60e478d018eae2e8ff2bcd2192e39a948cc1acbc76"} Jun 05 17:53:12.236174 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:12.236135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh45g" event={"ID":"0afed098-ee13-41f5-a7d8-1c245a5127b7","Type":"ContainerStarted","Data":"5cc70ef8aea09407c5b31277c5256812e485780c14e24f7b3d9b4b23e7795f29"} Jun 05 17:53:12.236668 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:12.236197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh45g" event={"ID":"0afed098-ee13-41f5-a7d8-1c245a5127b7","Type":"ContainerStarted","Data":"cdd43f420a1facbe5af4ca08a13bd45c5ecd1d34de932e56b308d63f9f61bd64"} Jun 05 17:53:12.238370 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:12.238342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bdc764dcd-r6dkw" event={"ID":"633d56db-2dd1-4ade-9869-ff7172145d6e","Type":"ContainerStarted","Data":"20f88c5a8cfe468ae9270e20ce6f7a3c3b246ed459c9281828ecf3c9e23753ea"} Jun 05 17:53:12.253967 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:12.253920 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gh45g" podStartSLOduration=253.390241364 podStartE2EDuration="4m14.253905965s" totalImagesPullingTime="863.664601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:12.251932555 +0000 UTC m=+254.280667475" watchObservedRunningTime="2026-06-05 17:53:12.253905965 +0000 UTC m=+254.282640884" Jun 05 17:53:18.256569 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.256536 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64b459fc69-4tjww"] Jun 05 17:53:18.259441 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.259424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.262148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.262130 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 17:53:18.263345 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.263320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzlgh\"" Jun 05 17:53:18.263451 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.263379 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 17:53:18.263451 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.263384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 17:53:18.263854 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.263833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 17:53:18.263962 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.263942 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 17:53:18.264013 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.263978 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 17:53:18.265225 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.264856 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 17:53:18.271004 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.270980 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b459fc69-4tjww"] Jun 05 17:53:18.272541 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.272524 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 17:53:18.340379 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-config\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.340379 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-serving-cert\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.340610 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-oauth-serving-cert\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.340610 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfh5\" (UniqueName: \"kubernetes.io/projected/a4eeb849-8200-4d1d-bac6-15defdac52a0-kube-api-access-8dfh5\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.340610 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-oauth-config\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.340610 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-trusted-ca-bundle\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.340610 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.340588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-service-ca\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441180 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-service-ca\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441317 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-config\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441317 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-serving-cert\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441427 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-oauth-serving-cert\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441480 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfh5\" (UniqueName: \"kubernetes.io/projected/a4eeb849-8200-4d1d-bac6-15defdac52a0-kube-api-access-8dfh5\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441537 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-oauth-config\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441585 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-trusted-ca-bundle\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.441941 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441913 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-config\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.442068 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.441945 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-service-ca\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.442139 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.442093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-oauth-serving-cert\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.442449 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.442428 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-trusted-ca-bundle\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.443908 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.443881 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-oauth-config\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.443983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.443905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-serving-cert\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.460045 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.460019 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfh5\" (UniqueName: \"kubernetes.io/projected/a4eeb849-8200-4d1d-bac6-15defdac52a0-kube-api-access-8dfh5\") pod \"console-64b459fc69-4tjww\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.569690 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.569556 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:18.695132 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:18.695100 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b459fc69-4tjww"] Jun 05 17:53:18.698268 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:18.698233 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4eeb849_8200_4d1d_bac6_15defdac52a0.slice/crio-ca34329d1d737ea16db5db9a4998c3bd363ccbb157ac7f43a52740121202174a WatchSource:0}: Error finding container ca34329d1d737ea16db5db9a4998c3bd363ccbb157ac7f43a52740121202174a: Status 404 returned error can't find the container with id ca34329d1d737ea16db5db9a4998c3bd363ccbb157ac7f43a52740121202174a Jun 05 17:53:19.263263 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.263226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b459fc69-4tjww" event={"ID":"a4eeb849-8200-4d1d-bac6-15defdac52a0","Type":"ContainerStarted","Data":"ca34329d1d737ea16db5db9a4998c3bd363ccbb157ac7f43a52740121202174a"} Jun 05 17:53:19.282821 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.282791 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jxvwb"] Jun 05 17:53:19.285982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.285958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.289234 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.289179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 17:53:19.289234 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.289229 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 17:53:19.290461 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.290439 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 17:53:19.290556 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.290480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 17:53:19.290556 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.290495 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 17:53:19.290556 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.290449 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 17:53:19.290772 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.290440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-chqsh\"" Jun 05 17:53:19.348815 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.348780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.348997 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.348840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-tls\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.348997 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.348921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-root\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.348997 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.348957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-textfile\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.349159 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.349015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.349159 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.349045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-wtmp\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.349159 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.349086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-metrics-client-ca\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.349306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.349151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncd67\" (UniqueName: \"kubernetes.io/projected/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-kube-api-access-ncd67\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.349306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.349272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-sys\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450402 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-textfile\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450573 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450573 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-wtmp\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450573 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-metrics-client-ca\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450573 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncd67\" (UniqueName: \"kubernetes.io/projected/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-kube-api-access-ncd67\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450809 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450663 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-wtmp\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450809 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-sys\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450809 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-textfile\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-tls\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450854 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-sys\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-root\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.450982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.450913 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-root\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.451320 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.451273 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.451476 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.451454 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-metrics-client-ca\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.453372 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.453336 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.453601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.453556 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-node-exporter-tls\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.459447 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.459402 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncd67\" (UniqueName: \"kubernetes.io/projected/6c0eb43c-04bd-4d81-9a16-1f6ad2757286-kube-api-access-ncd67\") pod \"node-exporter-jxvwb\" (UID: \"6c0eb43c-04bd-4d81-9a16-1f6ad2757286\") " pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.597678 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:19.597569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxvwb" Jun 05 17:53:19.610365 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:19.610335 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0eb43c_04bd_4d81_9a16_1f6ad2757286.slice/crio-5721d2224c03a3f5434dc907e77f9c61fd8e64425d3e223d113e7a84d9e6a015 WatchSource:0}: Error finding container 5721d2224c03a3f5434dc907e77f9c61fd8e64425d3e223d113e7a84d9e6a015: Status 404 returned error can't find the container with id 5721d2224c03a3f5434dc907e77f9c61fd8e64425d3e223d113e7a84d9e6a015 Jun 05 17:53:20.268691 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.268653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxvwb" event={"ID":"6c0eb43c-04bd-4d81-9a16-1f6ad2757286","Type":"ContainerStarted","Data":"5721d2224c03a3f5434dc907e77f9c61fd8e64425d3e223d113e7a84d9e6a015"} Jun 05 17:53:20.287220 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.287191 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:53:20.291165 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.291142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.294426 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.294134 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 17:53:20.294426 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.294265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 17:53:20.294426 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.294290 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 17:53:20.294426 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.294391 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 17:53:20.295078 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.295020 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 17:53:20.295201 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.295170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 17:53:20.295201 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.295177 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 17:53:20.295587 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.295463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bkf9t\"" Jun 05 17:53:20.295587 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.295490 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 17:53:20.295587 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.295496 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 17:53:20.305347 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.305325 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:53:20.357856 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.357823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358021 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.357875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8l2\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-kube-api-access-mc8l2\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358021 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.357907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358021 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.357956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-out\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358173 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358381 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358381 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-web-config\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.358381 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.358271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.458792 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.458983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.458983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8l2\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-kube-api-access-mc8l2\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.458983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.458983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.458983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.458988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-out\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459224 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-web-config\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459755 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459728 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.459896 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.459852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.460695 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.460528 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.462916 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.462881 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.463422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.463399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.463568 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.463518 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.463777 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.463751 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.464006 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.463982 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-web-config\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.464444 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.464419 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.464534 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.464510 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.464793 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.464769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.465330 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.465308 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-out\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.466614 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.466585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8l2\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-kube-api-access-mc8l2\") pod \"alertmanager-main-0\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:20.603818 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:20.603725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:53:21.214690 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.214651 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d5c866df4-lkhrs"] Jun 05 17:53:21.223997 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.223970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.227680 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.227337 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 17:53:21.227680 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.227430 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 17:53:21.227680 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.227476 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ffwr8\"" Jun 05 17:53:21.227680 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.227558 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5f0ca0s3pmq78\"" Jun 05 17:53:21.228119 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.228031 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 17:53:21.228119 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.228048 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 17:53:21.228119 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.228059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 17:53:21.228337 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.228122 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d5c866df4-lkhrs"] Jun 05 17:53:21.264799 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-grpc-tls\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.264935 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.264935 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.264935 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.264935 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-tls\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.265086 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxzm5\" (UniqueName: \"kubernetes.io/projected/fe335700-5b5d-4141-be5a-69677bdaad85-kube-api-access-mxzm5\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.265086 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.264981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe335700-5b5d-4141-be5a-69677bdaad85-metrics-client-ca\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.265086 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.265008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366365 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe335700-5b5d-4141-be5a-69677bdaad85-metrics-client-ca\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-grpc-tls\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-tls\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.366986 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.366746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxzm5\" (UniqueName: \"kubernetes.io/projected/fe335700-5b5d-4141-be5a-69677bdaad85-kube-api-access-mxzm5\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.367365 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.367207 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe335700-5b5d-4141-be5a-69677bdaad85-metrics-client-ca\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.369810 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.369739 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.369810 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.369762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.369983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.369942 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.370061 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.370040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-grpc-tls\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.370234 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.370211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-tls\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.370331 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.370312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe335700-5b5d-4141-be5a-69677bdaad85-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.376523 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.376500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxzm5\" (UniqueName: \"kubernetes.io/projected/fe335700-5b5d-4141-be5a-69677bdaad85-kube-api-access-mxzm5\") pod \"thanos-querier-7d5c866df4-lkhrs\" (UID: \"fe335700-5b5d-4141-be5a-69677bdaad85\") " pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.535916 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.535844 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:21.695336 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.695189 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:53:21.699457 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:21.699430 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ef38a3_e387_43df_a8bd_7fd0c0b21f7c.slice/crio-709be1549cf66d967c762d0281c5e05230f4eb214931f163355ce1fbf726895a WatchSource:0}: Error finding container 709be1549cf66d967c762d0281c5e05230f4eb214931f163355ce1fbf726895a: Status 404 returned error can't find the container with id 709be1549cf66d967c762d0281c5e05230f4eb214931f163355ce1fbf726895a Jun 05 17:53:21.712154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:21.712121 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d5c866df4-lkhrs"] Jun 05 17:53:21.716530 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:21.716501 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe335700_5b5d_4141_be5a_69677bdaad85.slice/crio-24551a53cb6898fdd5c89a6c6227914a9af0976bb0c110072889586f7133b35c WatchSource:0}: Error finding container 24551a53cb6898fdd5c89a6c6227914a9af0976bb0c110072889586f7133b35c: Status 404 returned error can't find the container with id 24551a53cb6898fdd5c89a6c6227914a9af0976bb0c110072889586f7133b35c Jun 05 17:53:22.278609 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:22.278562 2579 generic.go:356] "Generic (PLEG): container finished" podID="6c0eb43c-04bd-4d81-9a16-1f6ad2757286" containerID="5760e4a12028c925407b5f5cd2e936f85d1f69a2e2b4b0d4be06a0dcbe5142fe" exitCode=0 Jun 05 17:53:22.278609 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:22.278604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxvwb" event={"ID":"6c0eb43c-04bd-4d81-9a16-1f6ad2757286","Type":"ContainerDied","Data":"5760e4a12028c925407b5f5cd2e936f85d1f69a2e2b4b0d4be06a0dcbe5142fe"} Jun 05 17:53:22.280139 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:22.280095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"24551a53cb6898fdd5c89a6c6227914a9af0976bb0c110072889586f7133b35c"} Jun 05 17:53:22.282116 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:22.282062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b459fc69-4tjww" event={"ID":"a4eeb849-8200-4d1d-bac6-15defdac52a0","Type":"ContainerStarted","Data":"684d8dcd49a79d2f6a0342b563e468a583194b3aa5f76f0239e7ec7fbd8b230b"} Jun 05 17:53:22.283937 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:22.283907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"709be1549cf66d967c762d0281c5e05230f4eb214931f163355ce1fbf726895a"} Jun 05 17:53:23.290127 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:23.290086 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxvwb" event={"ID":"6c0eb43c-04bd-4d81-9a16-1f6ad2757286","Type":"ContainerStarted","Data":"a0ad3766c640ba61a6e976137b97ebe7a85860fae9e2a8736519f48bb6023070"} Jun 05 17:53:23.290594 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:23.290192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxvwb" event={"ID":"6c0eb43c-04bd-4d81-9a16-1f6ad2757286","Type":"ContainerStarted","Data":"4ca4e3dd6952e986098dadfcff6b98fd18678124ac1f85336cd4b391d1fcd8da"} Jun 05 17:53:23.291976 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:23.291948 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8" exitCode=0 Jun 05 17:53:23.292106 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:23.292009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8"} Jun 05 17:53:23.310122 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:23.310079 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64b459fc69-4tjww" podStartSLOduration=2.462273946 podStartE2EDuration="5.310064675s" totalImagesPullingTime="2.847790729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:22.318097941 +0000 UTC m=+264.346832861" watchObservedRunningTime="2026-06-05 17:53:23.310064675 +0000 UTC m=+265.338799596" Jun 05 17:53:23.310476 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:23.310449 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jxvwb" podStartSLOduration=2.2946654029999998 podStartE2EDuration="4.310441266s" totalImagesPullingTime="1.935249177s" totalInitContainerRuntime="80.526686ms" isStatefulPod=true podCreationTimestamp="2026-06-05 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:23.308525745 +0000 UTC m=+265.337260667" watchObservedRunningTime="2026-06-05 17:53:23.310441266 +0000 UTC m=+265.339176185" Jun 05 17:53:24.010753 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.010722 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q"] Jun 05 17:53:24.014258 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.014234 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.016784 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.016718 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 17:53:24.016784 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.016755 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j8c2z\"" Jun 05 17:53:24.023926 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.023819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q"] Jun 05 17:53:24.091092 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.091052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtkh2\" (UniqueName: \"kubernetes.io/projected/95172d20-c3d7-400b-8fe4-0b47035d0217-kube-api-access-xtkh2\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.091265 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.091208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95172d20-c3d7-400b-8fe4-0b47035d0217-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.192195 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.192159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95172d20-c3d7-400b-8fe4-0b47035d0217-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.192398 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:53:24.192334 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 17:53:24.192398 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.192376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtkh2\" (UniqueName: \"kubernetes.io/projected/95172d20-c3d7-400b-8fe4-0b47035d0217-kube-api-access-xtkh2\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.192511 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:53:24.192403 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95172d20-c3d7-400b-8fe4-0b47035d0217-monitoring-plugin-cert podName:95172d20-c3d7-400b-8fe4-0b47035d0217 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:24.692381483 +0000 UTC m=+266.721116395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/95172d20-c3d7-400b-8fe4-0b47035d0217-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-9nt6q" (UID: "95172d20-c3d7-400b-8fe4-0b47035d0217") : secret "monitoring-plugin-cert" not found Jun 05 17:53:24.201533 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.201501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtkh2\" (UniqueName: \"kubernetes.io/projected/95172d20-c3d7-400b-8fe4-0b47035d0217-kube-api-access-xtkh2\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.298992 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.298908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"ff7df5b49ffe23b6ce2adc8348717a96a9b7d2e525866b0ede3ffd474efd6f76"} Jun 05 17:53:24.298992 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.298977 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"91092b49064a79716eaecbcd96a75956697dd537c4475b25e91d16ee7794562b"} Jun 05 17:53:24.299467 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.299016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"474d40912d4b85b54298e81e26c80015504d745769d953f2ccf0d0d22ac90ba0"} Jun 05 17:53:24.696516 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.696477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95172d20-c3d7-400b-8fe4-0b47035d0217-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.699549 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.699515 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95172d20-c3d7-400b-8fe4-0b47035d0217-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9nt6q\" (UID: \"95172d20-c3d7-400b-8fe4-0b47035d0217\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:24.925954 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:24.925919 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:25.176130 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.176099 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q"] Jun 05 17:53:25.182448 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:25.182413 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95172d20_c3d7_400b_8fe4_0b47035d0217.slice/crio-b5790b7fdffb84e08cc3ec0a8cffbd7bb3691fc6ffd22a1c8253856c612fb7be WatchSource:0}: Error finding container b5790b7fdffb84e08cc3ec0a8cffbd7bb3691fc6ffd22a1c8253856c612fb7be: Status 404 returned error can't find the container with id b5790b7fdffb84e08cc3ec0a8cffbd7bb3691fc6ffd22a1c8253856c612fb7be Jun 05 17:53:25.306998 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.306897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"570f9148e6c054f21cf5ec7e9aacbca1fd0c7a4f87b994e939f8adf1d4b8927b"} Jun 05 17:53:25.307369 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.307034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"142704c4cfbaa19ecc76b06d497ccddd70889c37724305000e37a01100a2753e"} Jun 05 17:53:25.307369 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.307086 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" event={"ID":"fe335700-5b5d-4141-be5a-69677bdaad85","Type":"ContainerStarted","Data":"89988caee256bf98f1d900f2b82bd1da525f7512392c48e3655c58a09f9db9d4"} Jun 05 17:53:25.307369 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.307214 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:25.310425 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.310355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f"} Jun 05 17:53:25.310425 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.310423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0"} Jun 05 17:53:25.310543 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.310465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26"} Jun 05 17:53:25.310543 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.310505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816"} Jun 05 17:53:25.312121 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.312100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" event={"ID":"95172d20-c3d7-400b-8fe4-0b47035d0217","Type":"ContainerStarted","Data":"b5790b7fdffb84e08cc3ec0a8cffbd7bb3691fc6ffd22a1c8253856c612fb7be"} Jun 05 17:53:25.337468 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:25.337424 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" podStartSLOduration=1.251064028 podStartE2EDuration="4.337410279s" totalImagesPullingTime="3.086346251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:25.335463437 +0000 UTC m=+267.364198358" watchObservedRunningTime="2026-06-05 17:53:25.337410279 +0000 UTC m=+267.366145238" Jun 05 17:53:26.320328 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:26.320290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708"} Jun 05 17:53:26.320809 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:26.320376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerStarted","Data":"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8"} Jun 05 17:53:26.352170 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:26.352113 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.618478139 podStartE2EDuration="6.352095947s" totalImagesPullingTime="2.708438335s" totalInitContainerRuntime="25.179473ms" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:26.349572986 +0000 UTC m=+268.378307946" watchObservedRunningTime="2026-06-05 17:53:26.352095947 +0000 UTC m=+268.380830899" Jun 05 17:53:27.325154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:27.325109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" event={"ID":"95172d20-c3d7-400b-8fe4-0b47035d0217","Type":"ContainerStarted","Data":"336dcc0f48153557769c67ce29d197faa4ab8fd67f62096ca0412069ea2ca06c"} Jun 05 17:53:27.325603 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:27.325573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:27.330180 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:27.330160 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" Jun 05 17:53:27.342384 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:27.342341 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9nt6q" podStartSLOduration=2.976750699 podStartE2EDuration="4.34232756s" totalImagesPullingTime="1.365576861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:27.341862317 +0000 UTC m=+269.370597238" watchObservedRunningTime="2026-06-05 17:53:27.34232756 +0000 UTC m=+269.371062479" Jun 05 17:53:28.238312 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:28.238277 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b459fc69-4tjww"] Jun 05 17:53:28.570319 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:28.570247 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:31.326456 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:31.326428 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d5c866df4-lkhrs" Jun 05 17:53:38.951774 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:53:38.951730 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-79sgg" podUID="2bcf959c-c68e-4a11-9d52-ca73208273b2" Jun 05 17:53:39.366692 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:39.366666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79sgg" Jun 05 17:53:42.948774 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:42.948726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:53:42.951028 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:42.951004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcf959c-c68e-4a11-9d52-ca73208273b2-metrics-tls\") pod \"dns-default-79sgg\" (UID: \"2bcf959c-c68e-4a11-9d52-ca73208273b2\") " pod="openshift-dns/dns-default-79sgg" Jun 05 17:53:42.970742 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:42.970720 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4cc\"" Jun 05 17:53:42.979050 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:42.979036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79sgg" Jun 05 17:53:43.115405 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:43.115380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79sgg"] Jun 05 17:53:43.117949 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:53:43.117911 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcf959c_c68e_4a11_9d52_ca73208273b2.slice/crio-0c487ea8895cea51d620dd5270437d8e708871ab99f6a579e55714145cf96537 WatchSource:0}: Error finding container 0c487ea8895cea51d620dd5270437d8e708871ab99f6a579e55714145cf96537: Status 404 returned error can't find the container with id 0c487ea8895cea51d620dd5270437d8e708871ab99f6a579e55714145cf96537 Jun 05 17:53:43.387295 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:43.387259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79sgg" event={"ID":"2bcf959c-c68e-4a11-9d52-ca73208273b2","Type":"ContainerStarted","Data":"0c487ea8895cea51d620dd5270437d8e708871ab99f6a579e55714145cf96537"} Jun 05 17:53:45.395827 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:45.395793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79sgg" event={"ID":"2bcf959c-c68e-4a11-9d52-ca73208273b2","Type":"ContainerStarted","Data":"8b1daef585701216db98125daf3a8fd288f9ce34359df078cc3bed4741697c31"} Jun 05 17:53:45.395827 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:45.395847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79sgg" event={"ID":"2bcf959c-c68e-4a11-9d52-ca73208273b2","Type":"ContainerStarted","Data":"d0c3d98a95f9d8e1c762b45d36d2370dbd74a6c7d24367cc6fda079175f77bba"} Jun 05 17:53:45.396310 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:45.395907 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-79sgg" Jun 05 17:53:45.418877 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:45.418822 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-79sgg" podStartSLOduration=251.887245041 podStartE2EDuration="4m13.418808723s" totalImagesPullingTime="1.531563682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:45.418701503 +0000 UTC m=+287.447436425" watchObservedRunningTime="2026-06-05 17:53:45.418808723 +0000 UTC m=+287.447543643" Jun 05 17:53:53.257707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.257663 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64b459fc69-4tjww" podUID="a4eeb849-8200-4d1d-bac6-15defdac52a0" containerName="console" containerID="cri-o://684d8dcd49a79d2f6a0342b563e468a583194b3aa5f76f0239e7ec7fbd8b230b" gracePeriod=15 Jun 05 17:53:53.428539 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.428507 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4eeb849-8200-4d1d-bac6-15defdac52a0" containerID="684d8dcd49a79d2f6a0342b563e468a583194b3aa5f76f0239e7ec7fbd8b230b" exitCode=0 Jun 05 17:53:53.428696 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.428657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b459fc69-4tjww" event={"ID":"a4eeb849-8200-4d1d-bac6-15defdac52a0","Type":"ContainerDied","Data":"684d8dcd49a79d2f6a0342b563e468a583194b3aa5f76f0239e7ec7fbd8b230b"} Jun 05 17:53:53.516605 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.516554 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:53.639532 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639496 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-oauth-serving-cert\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.639749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639553 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-service-ca\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.639749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639582 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-oauth-config\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.639749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639655 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-config\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.639749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639697 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dfh5\" (UniqueName: \"kubernetes.io/projected/a4eeb849-8200-4d1d-bac6-15defdac52a0-kube-api-access-8dfh5\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.639749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639720 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-serving-cert\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.639990 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.639755 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-trusted-ca-bundle\") pod \"a4eeb849-8200-4d1d-bac6-15defdac52a0\" (UID: \"a4eeb849-8200-4d1d-bac6-15defdac52a0\") " Jun 05 17:53:53.640058 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.640026 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:53.640117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.640037 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:53.640117 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.640090 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-config" (OuterVolumeSpecName: "console-config") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:53.640289 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.640270 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:53.641936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.641907 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:53:53.641936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.641929 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:53:53.642032 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.641965 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4eeb849-8200-4d1d-bac6-15defdac52a0-kube-api-access-8dfh5" (OuterVolumeSpecName: "kube-api-access-8dfh5") pod "a4eeb849-8200-4d1d-bac6-15defdac52a0" (UID: "a4eeb849-8200-4d1d-bac6-15defdac52a0"). InnerVolumeSpecName "kube-api-access-8dfh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:53:53.740608 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740578 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-service-ca\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:53.740608 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740602 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-oauth-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:53.740608 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740613 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:53.740905 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740640 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dfh5\" (UniqueName: \"kubernetes.io/projected/a4eeb849-8200-4d1d-bac6-15defdac52a0-kube-api-access-8dfh5\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:53.740905 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740649 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eeb849-8200-4d1d-bac6-15defdac52a0-console-serving-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:53.740905 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740657 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-trusted-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:53.740905 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:53.740665 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eeb849-8200-4d1d-bac6-15defdac52a0-oauth-serving-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:53:54.433575 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:54.433555 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b459fc69-4tjww" Jun 05 17:53:54.433575 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:54.433566 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b459fc69-4tjww" event={"ID":"a4eeb849-8200-4d1d-bac6-15defdac52a0","Type":"ContainerDied","Data":"ca34329d1d737ea16db5db9a4998c3bd363ccbb157ac7f43a52740121202174a"} Jun 05 17:53:54.433975 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:54.433614 2579 scope.go:117] "RemoveContainer" containerID="684d8dcd49a79d2f6a0342b563e468a583194b3aa5f76f0239e7ec7fbd8b230b" Jun 05 17:53:54.455489 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:54.455465 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b459fc69-4tjww"] Jun 05 17:53:54.458768 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:54.458746 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64b459fc69-4tjww"] Jun 05 17:53:55.402073 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:55.402042 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-79sgg" Jun 05 17:53:56.425883 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:56.425850 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4eeb849-8200-4d1d-bac6-15defdac52a0" path="/var/lib/kubelet/pods/a4eeb849-8200-4d1d-bac6-15defdac52a0/volumes" Jun 05 17:53:58.382592 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:53:58.382570 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 17:54:03.230118 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:03.230089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79sgg_2bcf959c-c68e-4a11-9d52-ca73208273b2/dns/0.log" Jun 05 17:54:03.429872 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:03.429827 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79sgg_2bcf959c-c68e-4a11-9d52-ca73208273b2/kube-rbac-proxy/0.log" Jun 05 17:54:04.429795 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:04.429767 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lf7vp_5be06fc6-2689-4af7-9794-d16f5c8b4ba6/dns-node-resolver/0.log" Jun 05 17:54:05.229712 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:05.229683 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc2cg_82cd66c7-5022-43c7-9f2e-493580bc9c9b/serve-healthcheck-canary/0.log" Jun 05 17:54:39.576675 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.576578 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:54:39.577154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.576871 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="alertmanager" containerID="cri-o://f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816" gracePeriod=120 Jun 05 17:54:39.577154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.576947 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-web" containerID="cri-o://0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0" gracePeriod=120 Jun 05 17:54:39.577154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.576986 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="prom-label-proxy" containerID="cri-o://24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708" gracePeriod=120 Jun 05 17:54:39.577154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.576993 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy" containerID="cri-o://ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f" gracePeriod=120 Jun 05 17:54:39.577154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.577017 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="config-reloader" containerID="cri-o://3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26" gracePeriod=120 Jun 05 17:54:39.577154 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:39.576937 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-metric" containerID="cri-o://7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8" gracePeriod=120 Jun 05 17:54:40.598978 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.598941 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708" exitCode=0 Jun 05 17:54:40.598978 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.598970 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f" exitCode=0 Jun 05 17:54:40.598978 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.598980 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26" exitCode=0 Jun 05 17:54:40.599422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.598990 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816" exitCode=0 Jun 05 17:54:40.599422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.599015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708"} Jun 05 17:54:40.599422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.599079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f"} Jun 05 17:54:40.599422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.599105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26"} Jun 05 17:54:40.599422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.599131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816"} Jun 05 17:54:40.828323 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.828299 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:40.876050 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876020 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc8l2\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-kube-api-access-mc8l2\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-main-tls\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876099 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-tls-assets\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876130 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-metrics-client-ca\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876193 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876228 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876215 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-out\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876243 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-volume\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876267 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-web-config\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876297 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-cluster-tls-config\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876344 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-web\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876370 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-main-db\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876529 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876398 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-trusted-ca-bundle\") pod \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\" (UID: \"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c\") " Jun 05 17:54:40.876954 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876923 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:40.877097 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.876966 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:40.877537 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.877274 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:54:40.879160 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.878926 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.879160 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.879044 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-kube-api-access-mc8l2" (OuterVolumeSpecName: "kube-api-access-mc8l2") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "kube-api-access-mc8l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:40.879934 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.879912 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-out" (OuterVolumeSpecName: "config-out") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:54:40.880028 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.879931 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.880386 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.880356 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.880521 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.880501 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.881071 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.881044 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:40.881179 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.881072 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-volume" (OuterVolumeSpecName: "config-volume") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.885379 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.885343 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.889420 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.889392 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-web-config" (OuterVolumeSpecName: "web-config") pod "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" (UID: "a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:40.977929 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977880 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-tls-assets\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.977929 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977923 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-metrics-client-ca\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.977929 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977934 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.977929 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977945 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977955 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-out\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977964 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-config-volume\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977972 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-web-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977980 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-cluster-tls-config\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977988 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.977996 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-main-db\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.978006 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.978014 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc8l2\" (UniqueName: \"kubernetes.io/projected/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-kube-api-access-mc8l2\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:40.978196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:40.978022 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c-secret-alertmanager-main-tls\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:54:41.605737 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605697 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8" exitCode=0 Jun 05 17:54:41.605737 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605729 2579 generic.go:356] "Generic (PLEG): container finished" podID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerID="0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0" exitCode=0 Jun 05 17:54:41.606157 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8"} Jun 05 17:54:41.606157 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605806 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.606157 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0"} Jun 05 17:54:41.606157 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c","Type":"ContainerDied","Data":"709be1549cf66d967c762d0281c5e05230f4eb214931f163355ce1fbf726895a"} Jun 05 17:54:41.606157 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.605912 2579 scope.go:117] "RemoveContainer" containerID="24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708" Jun 05 17:54:41.614382 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.614347 2579 scope.go:117] "RemoveContainer" containerID="7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8" Jun 05 17:54:41.621062 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.621042 2579 scope.go:117] "RemoveContainer" containerID="ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f" Jun 05 17:54:41.627415 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.627398 2579 scope.go:117] "RemoveContainer" containerID="0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0" Jun 05 17:54:41.630861 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.630837 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:54:41.634593 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.634553 2579 scope.go:117] "RemoveContainer" containerID="3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26" Jun 05 17:54:41.636905 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.636887 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:54:41.642244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.642229 2579 scope.go:117] "RemoveContainer" containerID="f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816" Jun 05 17:54:41.649000 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.648971 2579 scope.go:117] "RemoveContainer" containerID="0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8" Jun 05 17:54:41.659361 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.659342 2579 scope.go:117] "RemoveContainer" containerID="24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708" Jun 05 17:54:41.659701 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.659670 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708\": container with ID starting with 24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708 not found: ID does not exist" containerID="24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708" Jun 05 17:54:41.659789 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.659714 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708"} err="failed to get container status \"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708\": rpc error: code = NotFound desc = could not find container \"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708\": container with ID starting with 24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708 not found: ID does not exist" Jun 05 17:54:41.659789 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.659739 2579 scope.go:117] "RemoveContainer" containerID="7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8" Jun 05 17:54:41.659982 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.659968 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8\": container with ID starting with 7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8 not found: ID does not exist" containerID="7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8" Jun 05 17:54:41.660022 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.659985 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8"} err="failed to get container status \"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8\": rpc error: code = NotFound desc = could not find container \"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8\": container with ID starting with 7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8 not found: ID does not exist" Jun 05 17:54:41.660022 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.659997 2579 scope.go:117] "RemoveContainer" containerID="ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f" Jun 05 17:54:41.660205 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.660185 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f\": container with ID starting with ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f not found: ID does not exist" containerID="ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f" Jun 05 17:54:41.660246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660210 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f"} err="failed to get container status \"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f\": rpc error: code = NotFound desc = could not find container \"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f\": container with ID starting with ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f not found: ID does not exist" Jun 05 17:54:41.660246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660225 2579 scope.go:117] "RemoveContainer" containerID="0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0" Jun 05 17:54:41.660454 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.660432 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0\": container with ID starting with 0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0 not found: ID does not exist" containerID="0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0" Jun 05 17:54:41.660493 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660461 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0"} err="failed to get container status \"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0\": rpc error: code = NotFound desc = could not find container \"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0\": container with ID starting with 0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0 not found: ID does not exist" Jun 05 17:54:41.660493 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660478 2579 scope.go:117] "RemoveContainer" containerID="3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26" Jun 05 17:54:41.660719 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.660704 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26\": container with ID starting with 3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26 not found: ID does not exist" containerID="3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26" Jun 05 17:54:41.660772 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660722 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26"} err="failed to get container status \"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26\": rpc error: code = NotFound desc = could not find container \"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26\": container with ID starting with 3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26 not found: ID does not exist" Jun 05 17:54:41.660772 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660733 2579 scope.go:117] "RemoveContainer" containerID="f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816" Jun 05 17:54:41.660940 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.660924 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816\": container with ID starting with f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816 not found: ID does not exist" containerID="f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816" Jun 05 17:54:41.660979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660944 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816"} err="failed to get container status \"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816\": rpc error: code = NotFound desc = could not find container \"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816\": container with ID starting with f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816 not found: ID does not exist" Jun 05 17:54:41.660979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.660957 2579 scope.go:117] "RemoveContainer" containerID="0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8" Jun 05 17:54:41.661145 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:54:41.661129 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8\": container with ID starting with 0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8 not found: ID does not exist" containerID="0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8" Jun 05 17:54:41.661195 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661151 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8"} err="failed to get container status \"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8\": rpc error: code = NotFound desc = could not find container \"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8\": container with ID starting with 0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8 not found: ID does not exist" Jun 05 17:54:41.661195 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661169 2579 scope.go:117] "RemoveContainer" containerID="24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708" Jun 05 17:54:41.661405 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661389 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708"} err="failed to get container status \"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708\": rpc error: code = NotFound desc = could not find container \"24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708\": container with ID starting with 24fb156ae6aa02435c229a587df12031837e57d18934ee5b9af735f95be83708 not found: ID does not exist" Jun 05 17:54:41.661405 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661404 2579 scope.go:117] "RemoveContainer" containerID="7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8" Jun 05 17:54:41.661658 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661639 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8"} err="failed to get container status \"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8\": rpc error: code = NotFound desc = could not find container \"7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8\": container with ID starting with 7133e332d3687bf148e593a42b2533193ac99f7a289cf7759f8d75b9ee4b96d8 not found: ID does not exist" Jun 05 17:54:41.661707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661659 2579 scope.go:117] "RemoveContainer" containerID="ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f" Jun 05 17:54:41.661867 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661849 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f"} err="failed to get container status \"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f\": rpc error: code = NotFound desc = could not find container \"ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f\": container with ID starting with ed7b43dfb0c71d86caa5620aa3ef890ac50fa5d03b3d1c7b0432a106085e238f not found: ID does not exist" Jun 05 17:54:41.661910 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.661868 2579 scope.go:117] "RemoveContainer" containerID="0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0" Jun 05 17:54:41.662068 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662053 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0"} err="failed to get container status \"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0\": rpc error: code = NotFound desc = could not find container \"0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0\": container with ID starting with 0e933b4f06e5577f4ef9ba4a44d66ccbd6bfcbe006412060c1abe79fdd48f9e0 not found: ID does not exist" Jun 05 17:54:41.662068 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662068 2579 scope.go:117] "RemoveContainer" containerID="3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26" Jun 05 17:54:41.662262 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662244 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26"} err="failed to get container status \"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26\": rpc error: code = NotFound desc = could not find container \"3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26\": container with ID starting with 3b77f232c54dfbacda2bb762cf3ab2aaf6f66cfdd8667150747ad9af38f74a26 not found: ID does not exist" Jun 05 17:54:41.662302 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662263 2579 scope.go:117] "RemoveContainer" containerID="f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816" Jun 05 17:54:41.662462 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662444 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816"} err="failed to get container status \"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816\": rpc error: code = NotFound desc = could not find container \"f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816\": container with ID starting with f18d2aef5b94528fe37d3f5fd0408399084fd1c666683141a9237c84f8e7f816 not found: ID does not exist" Jun 05 17:54:41.662462 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662460 2579 scope.go:117] "RemoveContainer" containerID="0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8" Jun 05 17:54:41.662658 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.662620 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8"} err="failed to get container status \"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8\": rpc error: code = NotFound desc = could not find container \"0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8\": container with ID starting with 0071c4bc900f5ca639337aeda2a223160833971c7ed5bb63967c44e9affb1ce8 not found: ID does not exist" Jun 05 17:54:41.664991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.664971 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:54:41.665236 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665223 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="prom-label-proxy" Jun 05 17:54:41.665283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665238 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="prom-label-proxy" Jun 05 17:54:41.665283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665250 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-metric" Jun 05 17:54:41.665283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665255 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-metric" Jun 05 17:54:41.665283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665267 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="alertmanager" Jun 05 17:54:41.665283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665275 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="alertmanager" Jun 05 17:54:41.665283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665283 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4eeb849-8200-4d1d-bac6-15defdac52a0" containerName="console" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665288 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4eeb849-8200-4d1d-bac6-15defdac52a0" containerName="console" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665294 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-web" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665299 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-web" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665308 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="config-reloader" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665313 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="config-reloader" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665320 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665326 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665334 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="init-config-reloader" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665339 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="init-config-reloader" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665383 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-web" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665390 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665396 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="kube-rbac-proxy-metric" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665401 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="prom-label-proxy" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665408 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="config-reloader" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665414 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4eeb849-8200-4d1d-bac6-15defdac52a0" containerName="console" Jun 05 17:54:41.665448 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.665419 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" containerName="alertmanager" Jun 05 17:54:41.670303 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.670287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.672941 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.672923 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 17:54:41.673331 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.673309 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 17:54:41.673428 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.673309 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 17:54:41.673490 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.673433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 17:54:41.673600 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.673582 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 17:54:41.673717 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.673613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bkf9t\"" Jun 05 17:54:41.673909 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.673891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 17:54:41.674458 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.674438 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 17:54:41.674560 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.674479 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 17:54:41.678535 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.678520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 17:54:41.683882 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.683862 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:54:41.783118 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18e67694-9959-4dc9-8904-00335538a42b-config-out\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783118 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783321 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18e67694-9959-4dc9-8904-00335538a42b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783321 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwct\" (UniqueName: \"kubernetes.io/projected/18e67694-9959-4dc9-8904-00335538a42b-kube-api-access-hxwct\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783321 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-config-volume\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783321 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783321 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783321 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18e67694-9959-4dc9-8904-00335538a42b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783486 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-web-config\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783486 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783486 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18e67694-9959-4dc9-8904-00335538a42b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783486 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.783486 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.783444 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e67694-9959-4dc9-8904-00335538a42b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884285 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18e67694-9959-4dc9-8904-00335538a42b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884285 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-web-config\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884285 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18e67694-9959-4dc9-8904-00335538a42b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e67694-9959-4dc9-8904-00335538a42b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18e67694-9959-4dc9-8904-00335538a42b-config-out\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18e67694-9959-4dc9-8904-00335538a42b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884865 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwct\" (UniqueName: \"kubernetes.io/projected/18e67694-9959-4dc9-8904-00335538a42b-kube-api-access-hxwct\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884865 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-config-volume\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884865 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.884865 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.884691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.885955 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.885267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e67694-9959-4dc9-8904-00335538a42b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.885955 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.885531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18e67694-9959-4dc9-8904-00335538a42b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.887436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.887268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18e67694-9959-4dc9-8904-00335538a42b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.887436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.887375 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.887613 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.887462 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-web-config\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.887707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.887616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18e67694-9959-4dc9-8904-00335538a42b-config-out\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.887707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.887699 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18e67694-9959-4dc9-8904-00335538a42b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.887959 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.887936 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.888329 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.888299 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.888416 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.888349 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.888416 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.888371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-config-volume\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.889324 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.889307 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e67694-9959-4dc9-8904-00335538a42b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.893536 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.893518 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwct\" (UniqueName: \"kubernetes.io/projected/18e67694-9959-4dc9-8904-00335538a42b-kube-api-access-hxwct\") pod \"alertmanager-main-0\" (UID: \"18e67694-9959-4dc9-8904-00335538a42b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:41.979779 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:41.979742 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 17:54:42.118285 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:42.118242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 17:54:42.122278 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:54:42.122250 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e67694_9959_4dc9_8904_00335538a42b.slice/crio-2f2524de7dd8d91dd2f0977f9ba5ab67dbdf7b1a9399bff51afbd3e8c4b492f6 WatchSource:0}: Error finding container 2f2524de7dd8d91dd2f0977f9ba5ab67dbdf7b1a9399bff51afbd3e8c4b492f6: Status 404 returned error can't find the container with id 2f2524de7dd8d91dd2f0977f9ba5ab67dbdf7b1a9399bff51afbd3e8c4b492f6 Jun 05 17:54:42.425446 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:42.425370 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c" path="/var/lib/kubelet/pods/a8ef38a3-e387-43df-a8bd-7fd0c0b21f7c/volumes" Jun 05 17:54:42.610199 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:42.610165 2579 generic.go:356] "Generic (PLEG): container finished" podID="18e67694-9959-4dc9-8904-00335538a42b" containerID="5af1a125bf3ec835b271f63bed0d5a63854aef35f24345dc87c1c27ddb2389ca" exitCode=0 Jun 05 17:54:42.610651 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:42.610244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerDied","Data":"5af1a125bf3ec835b271f63bed0d5a63854aef35f24345dc87c1c27ddb2389ca"} Jun 05 17:54:42.610651 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:42.610302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"2f2524de7dd8d91dd2f0977f9ba5ab67dbdf7b1a9399bff51afbd3e8c4b492f6"} Jun 05 17:54:43.618351 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.618314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"ee6df1f4b4cf519c576b508a5b1bcbc49f55c2d28dd1ed1a6b09520f6cac4441"} Jun 05 17:54:43.618770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.618407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"7f961280478bf74afe3e3e35b5ae698e5fb63874bcfe9383e1668e4ae1860c94"} Jun 05 17:54:43.618770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.618436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"39bcda8a242c24576214042d40ae2c23ee0bf8bd5f1a84ad70abe29b0f904fad"} Jun 05 17:54:43.618770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.618464 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"aade1487dd17381f26cdc0b1f8234f105ae1dc9b880cafa1ab9078818726f728"} Jun 05 17:54:43.618770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.618488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"a739ab0061c18b29f212a3f9f9f483aaa2d098d6f56137d850145c860eedfaff"} Jun 05 17:54:43.618770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.618510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18e67694-9959-4dc9-8904-00335538a42b","Type":"ContainerStarted","Data":"1e4181fac5e1f976a266b8605e1365bc2648bd470b277399a274efb121484f72"} Jun 05 17:54:43.647371 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:54:43.647320 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.630453803 podStartE2EDuration="2.64730476s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.850957ms" isStatefulPod=false podCreationTimestamp="2026-06-05 17:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:54:43.646809971 +0000 UTC m=+345.675544896" watchObservedRunningTime="2026-06-05 17:54:43.64730476 +0000 UTC m=+345.676039725" Jun 05 17:56:22.638047 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.637967 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8"] Jun 05 17:56:22.645887 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.645861 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.648750 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.648682 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 17:56:22.648750 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.648688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b8ngf\"" Jun 05 17:56:22.648750 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.648746 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 17:56:22.649415 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.649394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8"] Jun 05 17:56:22.744422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.744379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.744422 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.744429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.744681 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.744502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgh8x\" (UniqueName: \"kubernetes.io/projected/2e5e206d-49c6-44eb-955f-b7f21f71943f-kube-api-access-dgh8x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.845559 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.845500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.845559 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.845573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.845809 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.845647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgh8x\" (UniqueName: \"kubernetes.io/projected/2e5e206d-49c6-44eb-955f-b7f21f71943f-kube-api-access-dgh8x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.845949 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.845930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.845989 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.845966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.855381 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.855359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgh8x\" (UniqueName: \"kubernetes.io/projected/2e5e206d-49c6-44eb-955f-b7f21f71943f-kube-api-access-dgh8x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:22.956580 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:22.956490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:23.086046 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:23.086013 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8"] Jun 05 17:56:23.089057 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:56:23.089027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5e206d_49c6_44eb_955f_b7f21f71943f.slice/crio-79b724aeabf973b4215b12302d1d5b6aaea24ab166449c5dcea8afec75711a95 WatchSource:0}: Error finding container 79b724aeabf973b4215b12302d1d5b6aaea24ab166449c5dcea8afec75711a95: Status 404 returned error can't find the container with id 79b724aeabf973b4215b12302d1d5b6aaea24ab166449c5dcea8afec75711a95 Jun 05 17:56:23.091088 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:23.091071 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 17:56:23.982328 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:23.982288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" event={"ID":"2e5e206d-49c6-44eb-955f-b7f21f71943f","Type":"ContainerStarted","Data":"79b724aeabf973b4215b12302d1d5b6aaea24ab166449c5dcea8afec75711a95"} Jun 05 17:56:30.008474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:30.008441 2579 generic.go:356] "Generic (PLEG): container finished" podID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerID="27b2a461bd0fc2de4244fc72c11914220342b3cdeb91b868ae99daef542311a1" exitCode=0 Jun 05 17:56:30.008910 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:30.008482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" event={"ID":"2e5e206d-49c6-44eb-955f-b7f21f71943f","Type":"ContainerDied","Data":"27b2a461bd0fc2de4244fc72c11914220342b3cdeb91b868ae99daef542311a1"} Jun 05 17:56:33.022456 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:33.022415 2579 generic.go:356] "Generic (PLEG): container finished" podID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerID="4707a21137c800eff4a91e047436724350865228cec12c1034ca7e9dd7068530" exitCode=0 Jun 05 17:56:33.022456 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:33.022461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" event={"ID":"2e5e206d-49c6-44eb-955f-b7f21f71943f","Type":"ContainerDied","Data":"4707a21137c800eff4a91e047436724350865228cec12c1034ca7e9dd7068530"} Jun 05 17:56:40.050693 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:40.050574 2579 generic.go:356] "Generic (PLEG): container finished" podID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerID="0672ef38395e0a58a02ab2d1655267bef6583bc9a898369bec500ffd79519edb" exitCode=0 Jun 05 17:56:40.050693 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:40.050669 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" event={"ID":"2e5e206d-49c6-44eb-955f-b7f21f71943f","Type":"ContainerDied","Data":"0672ef38395e0a58a02ab2d1655267bef6583bc9a898369bec500ffd79519edb"} Jun 05 17:56:41.179519 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.179497 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:41.295163 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.295124 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-bundle\") pod \"2e5e206d-49c6-44eb-955f-b7f21f71943f\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " Jun 05 17:56:41.295163 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.295162 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-util\") pod \"2e5e206d-49c6-44eb-955f-b7f21f71943f\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " Jun 05 17:56:41.295398 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.295243 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgh8x\" (UniqueName: \"kubernetes.io/projected/2e5e206d-49c6-44eb-955f-b7f21f71943f-kube-api-access-dgh8x\") pod \"2e5e206d-49c6-44eb-955f-b7f21f71943f\" (UID: \"2e5e206d-49c6-44eb-955f-b7f21f71943f\") " Jun 05 17:56:41.295612 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.295584 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-bundle" (OuterVolumeSpecName: "bundle") pod "2e5e206d-49c6-44eb-955f-b7f21f71943f" (UID: "2e5e206d-49c6-44eb-955f-b7f21f71943f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:56:41.297419 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.297395 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5e206d-49c6-44eb-955f-b7f21f71943f-kube-api-access-dgh8x" (OuterVolumeSpecName: "kube-api-access-dgh8x") pod "2e5e206d-49c6-44eb-955f-b7f21f71943f" (UID: "2e5e206d-49c6-44eb-955f-b7f21f71943f"). InnerVolumeSpecName "kube-api-access-dgh8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:56:41.299199 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.299174 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-util" (OuterVolumeSpecName: "util") pod "2e5e206d-49c6-44eb-955f-b7f21f71943f" (UID: "2e5e206d-49c6-44eb-955f-b7f21f71943f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:56:41.395982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.395949 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:56:41.395982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.395976 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e5e206d-49c6-44eb-955f-b7f21f71943f-util\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:56:41.395982 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:41.395985 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgh8x\" (UniqueName: \"kubernetes.io/projected/2e5e206d-49c6-44eb-955f-b7f21f71943f-kube-api-access-dgh8x\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:56:42.059295 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:42.059269 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" Jun 05 17:56:42.059461 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:42.059264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7d9h8" event={"ID":"2e5e206d-49c6-44eb-955f-b7f21f71943f","Type":"ContainerDied","Data":"79b724aeabf973b4215b12302d1d5b6aaea24ab166449c5dcea8afec75711a95"} Jun 05 17:56:42.059461 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:42.059382 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79b724aeabf973b4215b12302d1d5b6aaea24ab166449c5dcea8afec75711a95" Jun 05 17:56:45.920042 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920006 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c"] Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920271 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="util" Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920281 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="util" Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920297 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="extract" Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920303 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="extract" Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920311 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="pull" Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920317 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="pull" Jun 05 17:56:45.920436 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.920358 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5e206d-49c6-44eb-955f-b7f21f71943f" containerName="extract" Jun 05 17:56:45.951601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.951576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c"] Jun 05 17:56:45.951759 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.951689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:45.954286 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.954264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 17:56:45.955329 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.955310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:56:45.955438 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:45.955341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lnmmm\"" Jun 05 17:56:46.031459 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.031426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twtbp\" (UniqueName: \"kubernetes.io/projected/543afb2e-cd4d-4184-9baa-e5c83c3140e0-kube-api-access-twtbp\") pod \"openshift-lws-operator-fd8ccff4c-6nw4c\" (UID: \"543afb2e-cd4d-4184-9baa-e5c83c3140e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.031611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.031497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/543afb2e-cd4d-4184-9baa-e5c83c3140e0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6nw4c\" (UID: \"543afb2e-cd4d-4184-9baa-e5c83c3140e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.132150 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.132122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/543afb2e-cd4d-4184-9baa-e5c83c3140e0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6nw4c\" (UID: \"543afb2e-cd4d-4184-9baa-e5c83c3140e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.132304 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.132173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twtbp\" (UniqueName: \"kubernetes.io/projected/543afb2e-cd4d-4184-9baa-e5c83c3140e0-kube-api-access-twtbp\") pod \"openshift-lws-operator-fd8ccff4c-6nw4c\" (UID: \"543afb2e-cd4d-4184-9baa-e5c83c3140e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.132476 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.132459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/543afb2e-cd4d-4184-9baa-e5c83c3140e0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6nw4c\" (UID: \"543afb2e-cd4d-4184-9baa-e5c83c3140e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.141066 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.141048 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twtbp\" (UniqueName: \"kubernetes.io/projected/543afb2e-cd4d-4184-9baa-e5c83c3140e0-kube-api-access-twtbp\") pod \"openshift-lws-operator-fd8ccff4c-6nw4c\" (UID: \"543afb2e-cd4d-4184-9baa-e5c83c3140e0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.260283 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.260186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" Jun 05 17:56:46.400927 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:46.400880 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c"] Jun 05 17:56:46.403829 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:56:46.403800 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod543afb2e_cd4d_4184_9baa_e5c83c3140e0.slice/crio-fbf9e64c367eaea718992b2bc30115e2079c273f70f5fb42c9209904e3e84b7a WatchSource:0}: Error finding container fbf9e64c367eaea718992b2bc30115e2079c273f70f5fb42c9209904e3e84b7a: Status 404 returned error can't find the container with id fbf9e64c367eaea718992b2bc30115e2079c273f70f5fb42c9209904e3e84b7a Jun 05 17:56:47.077013 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:47.076976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" event={"ID":"543afb2e-cd4d-4184-9baa-e5c83c3140e0","Type":"ContainerStarted","Data":"fbf9e64c367eaea718992b2bc30115e2079c273f70f5fb42c9209904e3e84b7a"} Jun 05 17:56:50.089523 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:50.089486 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" event={"ID":"543afb2e-cd4d-4184-9baa-e5c83c3140e0","Type":"ContainerStarted","Data":"42af720015cdca7415ec5b45708c8195c687ed90b036dd80eea36f0dfc5e429a"} Jun 05 17:56:50.106428 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:56:50.106375 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6nw4c" podStartSLOduration=2.160507716 podStartE2EDuration="5.106357616s" totalImagesPullingTime="2.9458499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:56:50.104957149 +0000 UTC m=+472.133692070" watchObservedRunningTime="2026-06-05 17:56:50.106357616 +0000 UTC m=+472.135092536" Jun 05 17:57:04.750589 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.750557 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l"] Jun 05 17:57:04.752556 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.752537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.755320 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.755297 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 17:57:04.756287 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.756273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 17:57:04.756352 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.756285 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-df7cv\"" Jun 05 17:57:04.756468 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.756445 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 17:57:04.763405 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.763384 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l"] Jun 05 17:57:04.878768 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.878727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e9a738c-e9ad-4879-8f1f-228406b1e137-cert\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.878974 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.878784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7m92\" (UniqueName: \"kubernetes.io/projected/2e9a738c-e9ad-4879-8f1f-228406b1e137-kube-api-access-l7m92\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.878974 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.878888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e9a738c-e9ad-4879-8f1f-228406b1e137-metrics-cert\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.878974 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.878917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e9a738c-e9ad-4879-8f1f-228406b1e137-manager-config\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.979574 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.979535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e9a738c-e9ad-4879-8f1f-228406b1e137-metrics-cert\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.979574 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.979575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e9a738c-e9ad-4879-8f1f-228406b1e137-manager-config\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.979793 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.979698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e9a738c-e9ad-4879-8f1f-228406b1e137-cert\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.979793 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.979761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7m92\" (UniqueName: \"kubernetes.io/projected/2e9a738c-e9ad-4879-8f1f-228406b1e137-kube-api-access-l7m92\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.980289 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.980257 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e9a738c-e9ad-4879-8f1f-228406b1e137-manager-config\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.982105 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.982084 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e9a738c-e9ad-4879-8f1f-228406b1e137-cert\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.982187 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.982173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e9a738c-e9ad-4879-8f1f-228406b1e137-metrics-cert\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:04.988994 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:04.988964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7m92\" (UniqueName: \"kubernetes.io/projected/2e9a738c-e9ad-4879-8f1f-228406b1e137-kube-api-access-l7m92\") pod \"lws-controller-manager-58878fcd45-vcc8l\" (UID: \"2e9a738c-e9ad-4879-8f1f-228406b1e137\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:05.062030 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:05.061933 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:05.198033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:05.198009 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l"] Jun 05 17:57:05.200617 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:57:05.200589 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9a738c_e9ad_4879_8f1f_228406b1e137.slice/crio-23307e78a8d4eba459a1c5898fedee5613d98a1df66920c9e5a2a1591cfefbe8 WatchSource:0}: Error finding container 23307e78a8d4eba459a1c5898fedee5613d98a1df66920c9e5a2a1591cfefbe8: Status 404 returned error can't find the container with id 23307e78a8d4eba459a1c5898fedee5613d98a1df66920c9e5a2a1591cfefbe8 Jun 05 17:57:06.148540 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:06.148500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" event={"ID":"2e9a738c-e9ad-4879-8f1f-228406b1e137","Type":"ContainerStarted","Data":"23307e78a8d4eba459a1c5898fedee5613d98a1df66920c9e5a2a1591cfefbe8"} Jun 05 17:57:07.154290 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:07.154258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" event={"ID":"2e9a738c-e9ad-4879-8f1f-228406b1e137","Type":"ContainerStarted","Data":"d59c66a3138fe3da62e1fc730738869bb5ee417cb8ae5b20dc6e36e4d794ca02"} Jun 05 17:57:07.154713 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:07.154348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:07.187675 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:07.187599 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" podStartSLOduration=1.4414721529999999 podStartE2EDuration="3.187579669s" totalImagesPullingTime="1.746107516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:07.185250684 +0000 UTC m=+489.213985605" watchObservedRunningTime="2026-06-05 17:57:07.187579669 +0000 UTC m=+489.216314589" Jun 05 17:57:09.203008 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.202978 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp"] Jun 05 17:57:09.205207 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.205188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.208368 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.208348 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 17:57:09.208515 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.208402 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 17:57:09.208918 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.208900 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 17:57:09.209243 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.209218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 17:57:09.209308 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.209246 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dj75z\"" Jun 05 17:57:09.226521 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.226500 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp"] Jun 05 17:57:09.315954 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.315920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.315954 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.315957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.316172 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.315980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.316172 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.316001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5thq\" (UniqueName: \"kubernetes.io/projected/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-kube-api-access-v5thq\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.316172 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.316053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.417315 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.417280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.417315 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.417318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.417520 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.417339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5thq\" (UniqueName: \"kubernetes.io/projected/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-kube-api-access-v5thq\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.417520 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.417383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.417520 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.417451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.417880 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.417857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.419735 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.419711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.419850 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.419736 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.419927 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.419907 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.425952 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.425931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5thq\" (UniqueName: \"kubernetes.io/projected/5cf8ee0f-6508-4645-bafe-9ca485fbd1e4-kube-api-access-v5thq\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp\" (UID: \"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.514579 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.514509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:09.658608 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:09.658569 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp"] Jun 05 17:57:09.664056 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:57:09.664020 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf8ee0f_6508_4645_bafe_9ca485fbd1e4.slice/crio-a231fe50eb2639fe08fbe89ee53f292794b944901e2faa3a139feea2fd30f8b9 WatchSource:0}: Error finding container a231fe50eb2639fe08fbe89ee53f292794b944901e2faa3a139feea2fd30f8b9: Status 404 returned error can't find the container with id a231fe50eb2639fe08fbe89ee53f292794b944901e2faa3a139feea2fd30f8b9 Jun 05 17:57:10.169939 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:10.169897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" event={"ID":"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4","Type":"ContainerStarted","Data":"a231fe50eb2639fe08fbe89ee53f292794b944901e2faa3a139feea2fd30f8b9"} Jun 05 17:57:13.187679 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:13.187618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" event={"ID":"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4","Type":"ContainerStarted","Data":"bf54b493605430e1d7c2b76aead23667ad10f81f60b5a15ec00f34525b2288ad"} Jun 05 17:57:14.193965 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:14.193927 2579 generic.go:356] "Generic (PLEG): container finished" podID="5cf8ee0f-6508-4645-bafe-9ca485fbd1e4" containerID="bf54b493605430e1d7c2b76aead23667ad10f81f60b5a15ec00f34525b2288ad" exitCode=0 Jun 05 17:57:14.194385 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:14.194022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" event={"ID":"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4","Type":"ContainerDied","Data":"bf54b493605430e1d7c2b76aead23667ad10f81f60b5a15ec00f34525b2288ad"} Jun 05 17:57:15.200305 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:15.200271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" event={"ID":"5cf8ee0f-6508-4645-bafe-9ca485fbd1e4","Type":"ContainerStarted","Data":"824006f1e8324f8aa29f3d19f929160d7222542d8e79daf33b7ef676f3c6358b"} Jun 05 17:57:15.200698 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:15.200406 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:57:15.227486 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:15.227399 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" podStartSLOduration=1.9891168989999999 podStartE2EDuration="6.227382369s" totalImagesPullingTime="3.250860866s" totalInitContainerRuntime="987.404604ms" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:15.225432368 +0000 UTC m=+497.254167289" watchObservedRunningTime="2026-06-05 17:57:15.227382369 +0000 UTC m=+497.256117291" Jun 05 17:57:18.160343 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:18.160313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-vcc8l" Jun 05 17:57:26.207652 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:57:26.207607 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp" Jun 05 17:58:04.492642 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.492587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dc4bb59b5-8mq9f"] Jun 05 17:58:04.503171 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.503142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.506109 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.506082 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 17:58:04.506109 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.506103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n486b\"" Jun 05 17:58:04.510708 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.510422 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dc4bb59b5-8mq9f"] Jun 05 17:58:04.536199 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.536167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7613f619-0a15-4d81-a9f2-b63c74a15ec5-redirect-config\") pod \"dashboard-redirect-dc4bb59b5-8mq9f\" (UID: \"7613f619-0a15-4d81-a9f2-b63c74a15ec5\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.536351 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.536217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmpx8\" (UniqueName: \"kubernetes.io/projected/7613f619-0a15-4d81-a9f2-b63c74a15ec5-kube-api-access-xmpx8\") pod \"dashboard-redirect-dc4bb59b5-8mq9f\" (UID: \"7613f619-0a15-4d81-a9f2-b63c74a15ec5\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.636718 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.636681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmpx8\" (UniqueName: \"kubernetes.io/projected/7613f619-0a15-4d81-a9f2-b63c74a15ec5-kube-api-access-xmpx8\") pod \"dashboard-redirect-dc4bb59b5-8mq9f\" (UID: \"7613f619-0a15-4d81-a9f2-b63c74a15ec5\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.636903 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.636749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7613f619-0a15-4d81-a9f2-b63c74a15ec5-redirect-config\") pod \"dashboard-redirect-dc4bb59b5-8mq9f\" (UID: \"7613f619-0a15-4d81-a9f2-b63c74a15ec5\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.637404 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.637384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7613f619-0a15-4d81-a9f2-b63c74a15ec5-redirect-config\") pod \"dashboard-redirect-dc4bb59b5-8mq9f\" (UID: \"7613f619-0a15-4d81-a9f2-b63c74a15ec5\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.645774 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.645750 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmpx8\" (UniqueName: \"kubernetes.io/projected/7613f619-0a15-4d81-a9f2-b63c74a15ec5-kube-api-access-xmpx8\") pod \"dashboard-redirect-dc4bb59b5-8mq9f\" (UID: \"7613f619-0a15-4d81-a9f2-b63c74a15ec5\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.814601 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.814497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" Jun 05 17:58:04.944113 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:04.944066 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dc4bb59b5-8mq9f"] Jun 05 17:58:04.947127 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:04.947086 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7613f619_0a15_4d81_a9f2_b63c74a15ec5.slice/crio-bb529563640a56b78c8e4f48b14a9cfce1568f8f0739049fbba2525c947149fa WatchSource:0}: Error finding container bb529563640a56b78c8e4f48b14a9cfce1568f8f0739049fbba2525c947149fa: Status 404 returned error can't find the container with id bb529563640a56b78c8e4f48b14a9cfce1568f8f0739049fbba2525c947149fa Jun 05 17:58:05.414404 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:05.414366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" event={"ID":"7613f619-0a15-4d81-a9f2-b63c74a15ec5","Type":"ContainerStarted","Data":"bb529563640a56b78c8e4f48b14a9cfce1568f8f0739049fbba2525c947149fa"} Jun 05 17:58:08.429971 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:08.429938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" event={"ID":"7613f619-0a15-4d81-a9f2-b63c74a15ec5","Type":"ContainerStarted","Data":"0fb0fb56f8e8b3cfec69a4997ffed48b96834b330c2354b931d961736d5b05e6"} Jun 05 17:58:08.447428 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:08.447375 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dc4bb59b5-8mq9f" podStartSLOduration=1.957871374 podStartE2EDuration="4.447358088s" totalImagesPullingTime="2.489486714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:08.445514464 +0000 UTC m=+550.474249381" watchObservedRunningTime="2026-06-05 17:58:08.447358088 +0000 UTC m=+550.476093055" Jun 05 17:58:19.374101 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.374066 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc"] Jun 05 17:58:19.376274 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.376256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.379744 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.379711 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 17:58:19.379876 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.379795 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gzhns\"" Jun 05 17:58:19.379876 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.379803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 17:58:19.380038 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.380025 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 17:58:19.404499 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.404461 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc"] Jun 05 17:58:19.440556 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440714 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440714 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440714 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440824 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440824 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlbp\" (UniqueName: \"kubernetes.io/projected/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-kube-api-access-5hlbp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440824 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440940 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.440940 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.440859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.541894 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.541860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.541894 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.541897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.541920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.541952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.541971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.541992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlbp\" (UniqueName: \"kubernetes.io/projected/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-kube-api-access-5hlbp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542135 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542514 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542514 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542394 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542514 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542472 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542691 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.542770 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.542748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.544413 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.544393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.544497 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.544442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.555004 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.554974 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlbp\" (UniqueName: \"kubernetes.io/projected/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-kube-api-access-5hlbp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.555086 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.555000 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d00aa8-5fa6-4d15-bd8a-a7613fbb8909-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795b82nc\" (UID: \"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.686391 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.686316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:19.815825 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:19.815799 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc"] Jun 05 17:58:19.818378 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:19.818346 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d00aa8_5fa6_4d15_bd8a_a7613fbb8909.slice/crio-41fe55a4f0d5e05eb83807cc2492283a9d3a9bdbdc579ea9dee004c9a863b496 WatchSource:0}: Error finding container 41fe55a4f0d5e05eb83807cc2492283a9d3a9bdbdc579ea9dee004c9a863b496: Status 404 returned error can't find the container with id 41fe55a4f0d5e05eb83807cc2492283a9d3a9bdbdc579ea9dee004c9a863b496 Jun 05 17:58:20.489798 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:20.489761 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" event={"ID":"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909","Type":"ContainerStarted","Data":"41fe55a4f0d5e05eb83807cc2492283a9d3a9bdbdc579ea9dee004c9a863b496"} Jun 05 17:58:22.706060 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:22.706018 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 17:58:22.706312 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:22.706097 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 17:58:22.706312 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:22.706127 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 17:58:23.507019 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:23.506977 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" event={"ID":"80d00aa8-5fa6-4d15-bd8a-a7613fbb8909","Type":"ContainerStarted","Data":"c3a463e28a774ae693fcf7bb2c1255f5e50bba423ed628192d099680b6a9239b"} Jun 05 17:58:23.527693 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:23.527620 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" podStartSLOduration=1.6422939429999999 podStartE2EDuration="4.527582312s" totalImagesPullingTime="2.885288369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:23.526541197 +0000 UTC m=+565.555276116" watchObservedRunningTime="2026-06-05 17:58:23.527582312 +0000 UTC m=+565.556317232" Jun 05 17:58:23.687281 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:23.687243 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:23.692015 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:23.691989 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:24.511196 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:24.511168 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:24.512174 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:24.512153 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795b82nc" Jun 05 17:58:29.678213 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.678181 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brkhr"] Jun 05 17:58:29.681928 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.681907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:29.684709 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.684685 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 17:58:29.685577 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.685556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 17:58:29.685704 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.685557 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lsh92\"" Jun 05 17:58:29.698062 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.698036 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brkhr"] Jun 05 17:58:29.734547 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.734500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tx4\" (UniqueName: \"kubernetes.io/projected/9adbb3f8-7bf3-4690-a495-0444366cdeb3-kube-api-access-56tx4\") pod \"kuadrant-operator-catalog-brkhr\" (UID: \"9adbb3f8-7bf3-4690-a495-0444366cdeb3\") " pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:29.835170 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.835127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tx4\" (UniqueName: \"kubernetes.io/projected/9adbb3f8-7bf3-4690-a495-0444366cdeb3-kube-api-access-56tx4\") pod \"kuadrant-operator-catalog-brkhr\" (UID: \"9adbb3f8-7bf3-4690-a495-0444366cdeb3\") " pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:29.843205 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.843174 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tx4\" (UniqueName: \"kubernetes.io/projected/9adbb3f8-7bf3-4690-a495-0444366cdeb3-kube-api-access-56tx4\") pod \"kuadrant-operator-catalog-brkhr\" (UID: \"9adbb3f8-7bf3-4690-a495-0444366cdeb3\") " pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:29.993272 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:29.993168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:30.044007 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.043976 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brkhr"] Jun 05 17:58:30.126404 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.126247 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brkhr"] Jun 05 17:58:30.128550 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:30.128522 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adbb3f8_7bf3_4690_a495_0444366cdeb3.slice/crio-466c6e0705b112350ce4bcbe810dd05efcb9da673279f3e937da1baa0a2fc849 WatchSource:0}: Error finding container 466c6e0705b112350ce4bcbe810dd05efcb9da673279f3e937da1baa0a2fc849: Status 404 returned error can't find the container with id 466c6e0705b112350ce4bcbe810dd05efcb9da673279f3e937da1baa0a2fc849 Jun 05 17:58:30.253437 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.253356 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jr45x"] Jun 05 17:58:30.257767 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.257751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:30.263962 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.263936 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jr45x"] Jun 05 17:58:30.338687 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.338646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpt4\" (UniqueName: \"kubernetes.io/projected/8118cf25-9d44-4208-920d-690b1896586a-kube-api-access-wjpt4\") pod \"kuadrant-operator-catalog-jr45x\" (UID: \"8118cf25-9d44-4208-920d-690b1896586a\") " pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:30.440148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.440114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpt4\" (UniqueName: \"kubernetes.io/projected/8118cf25-9d44-4208-920d-690b1896586a-kube-api-access-wjpt4\") pod \"kuadrant-operator-catalog-jr45x\" (UID: \"8118cf25-9d44-4208-920d-690b1896586a\") " pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:30.452931 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.452887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpt4\" (UniqueName: \"kubernetes.io/projected/8118cf25-9d44-4208-920d-690b1896586a-kube-api-access-wjpt4\") pod \"kuadrant-operator-catalog-jr45x\" (UID: \"8118cf25-9d44-4208-920d-690b1896586a\") " pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:30.536330 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.536240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" event={"ID":"9adbb3f8-7bf3-4690-a495-0444366cdeb3","Type":"ContainerStarted","Data":"466c6e0705b112350ce4bcbe810dd05efcb9da673279f3e937da1baa0a2fc849"} Jun 05 17:58:30.568088 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.568056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:30.750027 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:30.749957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jr45x"] Jun 05 17:58:30.812520 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:30.812440 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8118cf25_9d44_4208_920d_690b1896586a.slice/crio-cbf2383a719aad26579b4d1a402a3dae042416b22c156f695390033085e33c45 WatchSource:0}: Error finding container cbf2383a719aad26579b4d1a402a3dae042416b22c156f695390033085e33c45: Status 404 returned error can't find the container with id cbf2383a719aad26579b4d1a402a3dae042416b22c156f695390033085e33c45 Jun 05 17:58:31.543527 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.543487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" event={"ID":"8118cf25-9d44-4208-920d-690b1896586a","Type":"ContainerStarted","Data":"cbf2383a719aad26579b4d1a402a3dae042416b22c156f695390033085e33c45"} Jun 05 17:58:31.884128 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.884094 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c8c785cc-ntldq"] Jun 05 17:58:31.888079 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.888052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.894836 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.894804 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 17:58:31.894980 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.894881 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 17:58:31.894980 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.894804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 17:58:31.896275 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.896022 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 17:58:31.896398 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.896356 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 17:58:31.896398 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.896386 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 17:58:31.897044 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.897012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzlgh\"" Jun 05 17:58:31.899790 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.899767 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 17:58:31.916705 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.916669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c8c785cc-ntldq"] Jun 05 17:58:31.921428 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.921399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 17:58:31.954694 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.954642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skgsh\" (UniqueName: \"kubernetes.io/projected/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-kube-api-access-skgsh\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.954694 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.954696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-serving-cert\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.954949 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.954759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-config\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.954949 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.954856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-oauth-config\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.955054 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.954947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-oauth-serving-cert\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.955054 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.955030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-trusted-ca-bundle\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:31.955148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:31.955069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-service-ca\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.055848 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.055810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-oauth-serving-cert\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056026 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.055873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-trusted-ca-bundle\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056026 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-service-ca\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056164 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skgsh\" (UniqueName: \"kubernetes.io/projected/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-kube-api-access-skgsh\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056164 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-serving-cert\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056164 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-config\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056317 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-oauth-config\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056728 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056678 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-oauth-serving-cert\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056845 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056773 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-service-ca\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.056923 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.056898 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-trusted-ca-bundle\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.057083 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.057055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-config\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.058933 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.058910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-oauth-config\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.059282 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.059267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-console-serving-cert\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.065730 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.065707 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skgsh\" (UniqueName: \"kubernetes.io/projected/eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897-kube-api-access-skgsh\") pod \"console-84c8c785cc-ntldq\" (UID: \"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897\") " pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.201227 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.201135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:32.361109 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.361082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c8c785cc-ntldq"] Jun 05 17:58:32.362150 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:32.362118 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6ec811_eef7_4ff4_8eda_7d1a4bbe4897.slice/crio-22489802972ba13b7e4a7ae17f94db5976cc0277930659926d1357b7b2d01071 WatchSource:0}: Error finding container 22489802972ba13b7e4a7ae17f94db5976cc0277930659926d1357b7b2d01071: Status 404 returned error can't find the container with id 22489802972ba13b7e4a7ae17f94db5976cc0277930659926d1357b7b2d01071 Jun 05 17:58:32.554262 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.554176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" event={"ID":"9adbb3f8-7bf3-4690-a495-0444366cdeb3","Type":"ContainerStarted","Data":"18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535"} Jun 05 17:58:32.554432 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.554268 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" podUID="9adbb3f8-7bf3-4690-a495-0444366cdeb3" containerName="registry-server" containerID="cri-o://18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535" gracePeriod=2 Jun 05 17:58:32.555979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.555950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c8c785cc-ntldq" event={"ID":"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897","Type":"ContainerStarted","Data":"45830c3043df907253dacdf414f2e248fc9f78c15d641d4f2d3de0b1aa9cdf8f"} Jun 05 17:58:32.556080 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.556001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c8c785cc-ntldq" event={"ID":"eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897","Type":"ContainerStarted","Data":"22489802972ba13b7e4a7ae17f94db5976cc0277930659926d1357b7b2d01071"} Jun 05 17:58:32.557487 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.557463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" event={"ID":"8118cf25-9d44-4208-920d-690b1896586a","Type":"ContainerStarted","Data":"ef7d2ad66cefa66560fde596ada8706f9f7864f3b4ae2d0610f70b9eee7e04f6"} Jun 05 17:58:32.571876 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.571831 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" podStartSLOduration=1.406520924 podStartE2EDuration="3.571817551s" totalImagesPullingTime="2.165296627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:32.570678883 +0000 UTC m=+574.599413803" watchObservedRunningTime="2026-06-05 17:58:32.571817551 +0000 UTC m=+574.600552501" Jun 05 17:58:32.590726 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.590433 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c8c785cc-ntldq" podStartSLOduration=1.590411045 podStartE2EDuration="1.590411045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:32.588428932 +0000 UTC m=+574.617163849" watchObservedRunningTime="2026-06-05 17:58:32.590411045 +0000 UTC m=+574.619145967" Jun 05 17:58:32.605339 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.605293 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" podStartSLOduration=1.120409723 podStartE2EDuration="2.605276847s" totalImagesPullingTime="1.484867124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:32.603475173 +0000 UTC m=+574.632210103" watchObservedRunningTime="2026-06-05 17:58:32.605276847 +0000 UTC m=+574.634011767" Jun 05 17:58:32.782662 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.782619 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:32.863562 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.863529 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56tx4\" (UniqueName: \"kubernetes.io/projected/9adbb3f8-7bf3-4690-a495-0444366cdeb3-kube-api-access-56tx4\") pod \"9adbb3f8-7bf3-4690-a495-0444366cdeb3\" (UID: \"9adbb3f8-7bf3-4690-a495-0444366cdeb3\") " Jun 05 17:58:32.865765 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.865732 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adbb3f8-7bf3-4690-a495-0444366cdeb3-kube-api-access-56tx4" (OuterVolumeSpecName: "kube-api-access-56tx4") pod "9adbb3f8-7bf3-4690-a495-0444366cdeb3" (UID: "9adbb3f8-7bf3-4690-a495-0444366cdeb3"). InnerVolumeSpecName "kube-api-access-56tx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:58:32.964845 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:32.964806 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56tx4\" (UniqueName: \"kubernetes.io/projected/9adbb3f8-7bf3-4690-a495-0444366cdeb3-kube-api-access-56tx4\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:33.563269 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.563232 2579 generic.go:356] "Generic (PLEG): container finished" podID="9adbb3f8-7bf3-4690-a495-0444366cdeb3" containerID="18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535" exitCode=0 Jun 05 17:58:33.563474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.563281 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" Jun 05 17:58:33.563474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.563318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" event={"ID":"9adbb3f8-7bf3-4690-a495-0444366cdeb3","Type":"ContainerDied","Data":"18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535"} Jun 05 17:58:33.563474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.563365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brkhr" event={"ID":"9adbb3f8-7bf3-4690-a495-0444366cdeb3","Type":"ContainerDied","Data":"466c6e0705b112350ce4bcbe810dd05efcb9da673279f3e937da1baa0a2fc849"} Jun 05 17:58:33.563474 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.563386 2579 scope.go:117] "RemoveContainer" containerID="18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535" Jun 05 17:58:33.572649 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.572608 2579 scope.go:117] "RemoveContainer" containerID="18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535" Jun 05 17:58:33.572924 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:58:33.572906 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535\": container with ID starting with 18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535 not found: ID does not exist" containerID="18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535" Jun 05 17:58:33.572991 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.572933 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535"} err="failed to get container status \"18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535\": rpc error: code = NotFound desc = could not find container \"18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535\": container with ID starting with 18b18096bfb2174e486a7e9d0a8582c6758acb956836771dc6a48b86eeccc535 not found: ID does not exist" Jun 05 17:58:33.584802 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.584773 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brkhr"] Jun 05 17:58:33.589028 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:33.589005 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brkhr"] Jun 05 17:58:34.426082 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:34.426052 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9adbb3f8-7bf3-4690-a495-0444366cdeb3" path="/var/lib/kubelet/pods/9adbb3f8-7bf3-4690-a495-0444366cdeb3/volumes" Jun 05 17:58:40.568786 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:40.568741 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:40.569435 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:40.568807 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:40.590294 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:40.590261 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:40.614950 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:40.614925 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jr45x" Jun 05 17:58:41.906230 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.906193 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v"] Jun 05 17:58:41.906652 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.906497 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adbb3f8-7bf3-4690-a495-0444366cdeb3" containerName="registry-server" Jun 05 17:58:41.906652 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.906509 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adbb3f8-7bf3-4690-a495-0444366cdeb3" containerName="registry-server" Jun 05 17:58:41.906652 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.906571 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9adbb3f8-7bf3-4690-a495-0444366cdeb3" containerName="registry-server" Jun 05 17:58:41.918647 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.918603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:41.919039 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.919010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v"] Jun 05 17:58:41.921213 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:41.921192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j2czf\"" Jun 05 17:58:42.044205 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.044164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjxvw\" (UniqueName: \"kubernetes.io/projected/641ba905-3e16-4d29-aade-ead2053e36e0-kube-api-access-fjxvw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.044205 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.044212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.044420 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.044297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.145258 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.145216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjxvw\" (UniqueName: \"kubernetes.io/projected/641ba905-3e16-4d29-aade-ead2053e36e0-kube-api-access-fjxvw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.145258 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.145269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.145475 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.145317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.145792 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.145771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.145833 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.145781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.153931 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.153909 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjxvw\" (UniqueName: \"kubernetes.io/projected/641ba905-3e16-4d29-aade-ead2053e36e0-kube-api-access-fjxvw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.201979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.201862 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:42.201979 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.201963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:42.206945 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.206918 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:42.228604 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.228577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:42.358299 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.358275 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v"] Jun 05 17:58:42.360907 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:42.360880 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641ba905_3e16_4d29_aade_ead2053e36e0.slice/crio-3126c0b5bdd6c4073ed5a92e4c013c1b78a58a668b599cc44f3753e6e64bfe80 WatchSource:0}: Error finding container 3126c0b5bdd6c4073ed5a92e4c013c1b78a58a668b599cc44f3753e6e64bfe80: Status 404 returned error can't find the container with id 3126c0b5bdd6c4073ed5a92e4c013c1b78a58a668b599cc44f3753e6e64bfe80 Jun 05 17:58:42.489879 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.489844 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l"] Jun 05 17:58:42.493442 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.493424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.501477 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.501450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l"] Jun 05 17:58:42.608928 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.608891 2579 generic.go:356] "Generic (PLEG): container finished" podID="641ba905-3e16-4d29-aade-ead2053e36e0" containerID="5895a440d98788baf05fff087d4bc52524ed461eb718eeeb26d449deb39cac1b" exitCode=0 Jun 05 17:58:42.609127 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.608981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" event={"ID":"641ba905-3e16-4d29-aade-ead2053e36e0","Type":"ContainerDied","Data":"5895a440d98788baf05fff087d4bc52524ed461eb718eeeb26d449deb39cac1b"} Jun 05 17:58:42.609127 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.609071 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" event={"ID":"641ba905-3e16-4d29-aade-ead2053e36e0","Type":"ContainerStarted","Data":"3126c0b5bdd6c4073ed5a92e4c013c1b78a58a668b599cc44f3753e6e64bfe80"} Jun 05 17:58:42.613263 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.613243 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c8c785cc-ntldq" Jun 05 17:58:42.649723 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.649690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.649886 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.649738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqwv\" (UniqueName: \"kubernetes.io/projected/98da461f-fb8a-4a16-a799-594bdf330586-kube-api-access-nhqwv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.649886 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.649798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.750394 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.750290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.750616 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.750455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqwv\" (UniqueName: \"kubernetes.io/projected/98da461f-fb8a-4a16-a799-594bdf330586-kube-api-access-nhqwv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.750616 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.750506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.750802 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.750725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.750908 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.750860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.761877 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.761851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqwv\" (UniqueName: \"kubernetes.io/projected/98da461f-fb8a-4a16-a799-594bdf330586-kube-api-access-nhqwv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.835950 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.835912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:42.900401 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.900374 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq"] Jun 05 17:58:42.905198 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.905178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:42.911211 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.911187 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq"] Jun 05 17:58:42.972698 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:42.972656 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l"] Jun 05 17:58:42.974758 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:42.974730 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98da461f_fb8a_4a16_a799_594bdf330586.slice/crio-cc7a7eecc1c95348a140585e31d41f73217e08db2de718662c9f202defae0a26 WatchSource:0}: Error finding container cc7a7eecc1c95348a140585e31d41f73217e08db2de718662c9f202defae0a26: Status 404 returned error can't find the container with id cc7a7eecc1c95348a140585e31d41f73217e08db2de718662c9f202defae0a26 Jun 05 17:58:43.053412 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.053371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.053579 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.053442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2mb\" (UniqueName: \"kubernetes.io/projected/fb1a066d-4878-4523-b407-5fb537c517f6-kube-api-access-gw2mb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.053579 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.053545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.154232 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.154191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.154421 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.154265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2mb\" (UniqueName: \"kubernetes.io/projected/fb1a066d-4878-4523-b407-5fb537c517f6-kube-api-access-gw2mb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.154421 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.154304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.154617 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.154582 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.154725 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.154658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.164013 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.163987 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2mb\" (UniqueName: \"kubernetes.io/projected/fb1a066d-4878-4523-b407-5fb537c517f6-kube-api-access-gw2mb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.214877 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.214831 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:43.288266 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.288236 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx"] Jun 05 17:58:43.292856 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.292831 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.301893 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.301870 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx"] Jun 05 17:58:43.351445 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.351333 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq"] Jun 05 17:58:43.356480 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.356454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xdkp\" (UniqueName: \"kubernetes.io/projected/3602c13d-e172-4ffe-9eb1-cf8917b643a7-kube-api-access-7xdkp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.356616 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.356500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.356616 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.356518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.396816 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:43.396780 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1a066d_4878_4523_b407_5fb537c517f6.slice/crio-db9c8880f97faccf66b12fadae28fee84eec953cde06292db5a192572ce784c3 WatchSource:0}: Error finding container db9c8880f97faccf66b12fadae28fee84eec953cde06292db5a192572ce784c3: Status 404 returned error can't find the container with id db9c8880f97faccf66b12fadae28fee84eec953cde06292db5a192572ce784c3 Jun 05 17:58:43.457406 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.457378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xdkp\" (UniqueName: \"kubernetes.io/projected/3602c13d-e172-4ffe-9eb1-cf8917b643a7-kube-api-access-7xdkp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.457521 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.457437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.457521 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.457461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.457850 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.457821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.457923 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.457895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.466097 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.466072 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xdkp\" (UniqueName: \"kubernetes.io/projected/3602c13d-e172-4ffe-9eb1-cf8917b643a7-kube-api-access-7xdkp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.605060 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.605026 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:43.615614 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.615583 2579 generic.go:356] "Generic (PLEG): container finished" podID="641ba905-3e16-4d29-aade-ead2053e36e0" containerID="e885a09831b4a12b92db2ebc6d91fdbc182be50e5ee102a8cf93f472fe4e5db2" exitCode=0 Jun 05 17:58:43.615756 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.615659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" event={"ID":"641ba905-3e16-4d29-aade-ead2053e36e0","Type":"ContainerDied","Data":"e885a09831b4a12b92db2ebc6d91fdbc182be50e5ee102a8cf93f472fe4e5db2"} Jun 05 17:58:43.617402 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.617372 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb1a066d-4878-4523-b407-5fb537c517f6" containerID="b05b7deef893bb90b55f2f97ac19d4d0292659af8e5a4fe3436171850dbe16b0" exitCode=0 Jun 05 17:58:43.617490 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.617426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" event={"ID":"fb1a066d-4878-4523-b407-5fb537c517f6","Type":"ContainerDied","Data":"b05b7deef893bb90b55f2f97ac19d4d0292659af8e5a4fe3436171850dbe16b0"} Jun 05 17:58:43.617490 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.617468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" event={"ID":"fb1a066d-4878-4523-b407-5fb537c517f6","Type":"ContainerStarted","Data":"db9c8880f97faccf66b12fadae28fee84eec953cde06292db5a192572ce784c3"} Jun 05 17:58:43.622912 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.622885 2579 generic.go:356] "Generic (PLEG): container finished" podID="98da461f-fb8a-4a16-a799-594bdf330586" containerID="5644eaea59d3ac470a4dfe02c7fd5b842c9013ed4698464bc6c2b1ea6770e984" exitCode=0 Jun 05 17:58:43.623033 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.622986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" event={"ID":"98da461f-fb8a-4a16-a799-594bdf330586","Type":"ContainerDied","Data":"5644eaea59d3ac470a4dfe02c7fd5b842c9013ed4698464bc6c2b1ea6770e984"} Jun 05 17:58:43.623101 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.623035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" event={"ID":"98da461f-fb8a-4a16-a799-594bdf330586","Type":"ContainerStarted","Data":"cc7a7eecc1c95348a140585e31d41f73217e08db2de718662c9f202defae0a26"} Jun 05 17:58:43.749962 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:43.749933 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx"] Jun 05 17:58:43.752353 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:58:43.752330 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3602c13d_e172_4ffe_9eb1_cf8917b643a7.slice/crio-dfe17cbbae27bba957a4b424941cd6bd027769d22419e391102690d785cdc339 WatchSource:0}: Error finding container dfe17cbbae27bba957a4b424941cd6bd027769d22419e391102690d785cdc339: Status 404 returned error can't find the container with id dfe17cbbae27bba957a4b424941cd6bd027769d22419e391102690d785cdc339 Jun 05 17:58:44.628863 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.628831 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb1a066d-4878-4523-b407-5fb537c517f6" containerID="cf1f3dc1882bc967778db38048ce48e78a7d2e7b814f0ed5b40bacface28d867" exitCode=0 Jun 05 17:58:44.629312 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.628903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" event={"ID":"fb1a066d-4878-4523-b407-5fb537c517f6","Type":"ContainerDied","Data":"cf1f3dc1882bc967778db38048ce48e78a7d2e7b814f0ed5b40bacface28d867"} Jun 05 17:58:44.630900 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.630876 2579 generic.go:356] "Generic (PLEG): container finished" podID="98da461f-fb8a-4a16-a799-594bdf330586" containerID="f6fceeb841c60f4c1f85200fbb94eee7b232c0bdb56e80e2ac2ff739336b72a5" exitCode=0 Jun 05 17:58:44.631000 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.630960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" event={"ID":"98da461f-fb8a-4a16-a799-594bdf330586","Type":"ContainerDied","Data":"f6fceeb841c60f4c1f85200fbb94eee7b232c0bdb56e80e2ac2ff739336b72a5"} Jun 05 17:58:44.635139 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.635112 2579 generic.go:356] "Generic (PLEG): container finished" podID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerID="14a057cca067ff45f26dc9964e374d2ac9913edea341dab301e96957713d35fe" exitCode=0 Jun 05 17:58:44.635250 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.635206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" event={"ID":"3602c13d-e172-4ffe-9eb1-cf8917b643a7","Type":"ContainerDied","Data":"14a057cca067ff45f26dc9964e374d2ac9913edea341dab301e96957713d35fe"} Jun 05 17:58:44.635337 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.635261 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" event={"ID":"3602c13d-e172-4ffe-9eb1-cf8917b643a7","Type":"ContainerStarted","Data":"dfe17cbbae27bba957a4b424941cd6bd027769d22419e391102690d785cdc339"} Jun 05 17:58:44.637672 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.637649 2579 generic.go:356] "Generic (PLEG): container finished" podID="641ba905-3e16-4d29-aade-ead2053e36e0" containerID="8342667f1de036d8ae9a4c879128369f48d2bc08638ab419e85a9b4e6d51a717" exitCode=0 Jun 05 17:58:44.637789 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:44.637735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" event={"ID":"641ba905-3e16-4d29-aade-ead2053e36e0","Type":"ContainerDied","Data":"8342667f1de036d8ae9a4c879128369f48d2bc08638ab419e85a9b4e6d51a717"} Jun 05 17:58:45.643784 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.643745 2579 generic.go:356] "Generic (PLEG): container finished" podID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerID="b55a9bdf41473b8606b496d96d84d8863174e9516053ea837042806658ffbabb" exitCode=0 Jun 05 17:58:45.644194 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.643827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" event={"ID":"3602c13d-e172-4ffe-9eb1-cf8917b643a7","Type":"ContainerDied","Data":"b55a9bdf41473b8606b496d96d84d8863174e9516053ea837042806658ffbabb"} Jun 05 17:58:45.646168 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.646142 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb1a066d-4878-4523-b407-5fb537c517f6" containerID="0b7b2b93a07b22d934f9dd8d8fb73e6c0abcb7ba12c03ff35763651ab2b2d36b" exitCode=0 Jun 05 17:58:45.646288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.646224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" event={"ID":"fb1a066d-4878-4523-b407-5fb537c517f6","Type":"ContainerDied","Data":"0b7b2b93a07b22d934f9dd8d8fb73e6c0abcb7ba12c03ff35763651ab2b2d36b"} Jun 05 17:58:45.648350 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.648329 2579 generic.go:356] "Generic (PLEG): container finished" podID="98da461f-fb8a-4a16-a799-594bdf330586" containerID="02cfacb3335221996f7f2652698a1bb1b3f3ccc69c0b7f876a22fdfac400e7b8" exitCode=0 Jun 05 17:58:45.648450 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.648405 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" event={"ID":"98da461f-fb8a-4a16-a799-594bdf330586","Type":"ContainerDied","Data":"02cfacb3335221996f7f2652698a1bb1b3f3ccc69c0b7f876a22fdfac400e7b8"} Jun 05 17:58:45.783055 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.783033 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:45.878062 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.878028 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjxvw\" (UniqueName: \"kubernetes.io/projected/641ba905-3e16-4d29-aade-ead2053e36e0-kube-api-access-fjxvw\") pod \"641ba905-3e16-4d29-aade-ead2053e36e0\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " Jun 05 17:58:45.878062 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.878067 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-bundle\") pod \"641ba905-3e16-4d29-aade-ead2053e36e0\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " Jun 05 17:58:45.878288 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.878086 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-util\") pod \"641ba905-3e16-4d29-aade-ead2053e36e0\" (UID: \"641ba905-3e16-4d29-aade-ead2053e36e0\") " Jun 05 17:58:45.878720 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.878683 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-bundle" (OuterVolumeSpecName: "bundle") pod "641ba905-3e16-4d29-aade-ead2053e36e0" (UID: "641ba905-3e16-4d29-aade-ead2053e36e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:45.880110 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.880085 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641ba905-3e16-4d29-aade-ead2053e36e0-kube-api-access-fjxvw" (OuterVolumeSpecName: "kube-api-access-fjxvw") pod "641ba905-3e16-4d29-aade-ead2053e36e0" (UID: "641ba905-3e16-4d29-aade-ead2053e36e0"). InnerVolumeSpecName "kube-api-access-fjxvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:58:45.883553 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.883526 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-util" (OuterVolumeSpecName: "util") pod "641ba905-3e16-4d29-aade-ead2053e36e0" (UID: "641ba905-3e16-4d29-aade-ead2053e36e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:45.979315 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.979217 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjxvw\" (UniqueName: \"kubernetes.io/projected/641ba905-3e16-4d29-aade-ead2053e36e0-kube-api-access-fjxvw\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:45.979315 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.979253 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:45.979315 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:45.979262 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641ba905-3e16-4d29-aade-ead2053e36e0-util\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:46.655784 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.655750 2579 generic.go:356] "Generic (PLEG): container finished" podID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerID="b1608b45706cb8d7be20de9a5203e1298e3a8d4235d9c916633c9c5863d49cef" exitCode=0 Jun 05 17:58:46.656211 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.655832 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" event={"ID":"3602c13d-e172-4ffe-9eb1-cf8917b643a7","Type":"ContainerDied","Data":"b1608b45706cb8d7be20de9a5203e1298e3a8d4235d9c916633c9c5863d49cef"} Jun 05 17:58:46.657588 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.657569 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" Jun 05 17:58:46.657734 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.657599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v" event={"ID":"641ba905-3e16-4d29-aade-ead2053e36e0","Type":"ContainerDied","Data":"3126c0b5bdd6c4073ed5a92e4c013c1b78a58a668b599cc44f3753e6e64bfe80"} Jun 05 17:58:46.657734 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.657650 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3126c0b5bdd6c4073ed5a92e4c013c1b78a58a668b599cc44f3753e6e64bfe80" Jun 05 17:58:46.803528 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.803505 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:46.822443 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.822415 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:46.887307 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887259 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw2mb\" (UniqueName: \"kubernetes.io/projected/fb1a066d-4878-4523-b407-5fb537c517f6-kube-api-access-gw2mb\") pod \"fb1a066d-4878-4523-b407-5fb537c517f6\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " Jun 05 17:58:46.887491 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887360 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhqwv\" (UniqueName: \"kubernetes.io/projected/98da461f-fb8a-4a16-a799-594bdf330586-kube-api-access-nhqwv\") pod \"98da461f-fb8a-4a16-a799-594bdf330586\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " Jun 05 17:58:46.887491 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887388 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-util\") pod \"fb1a066d-4878-4523-b407-5fb537c517f6\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " Jun 05 17:58:46.887491 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887431 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-bundle\") pod \"98da461f-fb8a-4a16-a799-594bdf330586\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " Jun 05 17:58:46.887491 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887459 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-bundle\") pod \"fb1a066d-4878-4523-b407-5fb537c517f6\" (UID: \"fb1a066d-4878-4523-b407-5fb537c517f6\") " Jun 05 17:58:46.887748 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887494 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-util\") pod \"98da461f-fb8a-4a16-a799-594bdf330586\" (UID: \"98da461f-fb8a-4a16-a799-594bdf330586\") " Jun 05 17:58:46.888022 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.887991 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-bundle" (OuterVolumeSpecName: "bundle") pod "98da461f-fb8a-4a16-a799-594bdf330586" (UID: "98da461f-fb8a-4a16-a799-594bdf330586"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:46.888247 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.888223 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-bundle" (OuterVolumeSpecName: "bundle") pod "fb1a066d-4878-4523-b407-5fb537c517f6" (UID: "fb1a066d-4878-4523-b407-5fb537c517f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:46.889568 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.889543 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb1a066d-4878-4523-b407-5fb537c517f6-kube-api-access-gw2mb" (OuterVolumeSpecName: "kube-api-access-gw2mb") pod "fb1a066d-4878-4523-b407-5fb537c517f6" (UID: "fb1a066d-4878-4523-b407-5fb537c517f6"). InnerVolumeSpecName "kube-api-access-gw2mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:58:46.889667 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.889575 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98da461f-fb8a-4a16-a799-594bdf330586-kube-api-access-nhqwv" (OuterVolumeSpecName: "kube-api-access-nhqwv") pod "98da461f-fb8a-4a16-a799-594bdf330586" (UID: "98da461f-fb8a-4a16-a799-594bdf330586"). InnerVolumeSpecName "kube-api-access-nhqwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:58:46.893123 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.893104 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-util" (OuterVolumeSpecName: "util") pod "fb1a066d-4878-4523-b407-5fb537c517f6" (UID: "fb1a066d-4878-4523-b407-5fb537c517f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:46.893743 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.893721 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-util" (OuterVolumeSpecName: "util") pod "98da461f-fb8a-4a16-a799-594bdf330586" (UID: "98da461f-fb8a-4a16-a799-594bdf330586"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:46.988246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.988153 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhqwv\" (UniqueName: \"kubernetes.io/projected/98da461f-fb8a-4a16-a799-594bdf330586-kube-api-access-nhqwv\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:46.988246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.988184 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-util\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:46.988246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.988193 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:46.988246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.988201 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb1a066d-4878-4523-b407-5fb537c517f6-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:46.988246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.988208 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98da461f-fb8a-4a16-a799-594bdf330586-util\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:46.988246 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:46.988217 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw2mb\" (UniqueName: \"kubernetes.io/projected/fb1a066d-4878-4523-b407-5fb537c517f6-kube-api-access-gw2mb\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:47.664650 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.664602 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" Jun 05 17:58:47.664650 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.664599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq" event={"ID":"fb1a066d-4878-4523-b407-5fb537c517f6","Type":"ContainerDied","Data":"db9c8880f97faccf66b12fadae28fee84eec953cde06292db5a192572ce784c3"} Jun 05 17:58:47.665182 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.664683 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db9c8880f97faccf66b12fadae28fee84eec953cde06292db5a192572ce784c3" Jun 05 17:58:47.666435 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.666416 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" Jun 05 17:58:47.666580 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.666441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l" event={"ID":"98da461f-fb8a-4a16-a799-594bdf330586","Type":"ContainerDied","Data":"cc7a7eecc1c95348a140585e31d41f73217e08db2de718662c9f202defae0a26"} Jun 05 17:58:47.666580 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.666479 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc7a7eecc1c95348a140585e31d41f73217e08db2de718662c9f202defae0a26" Jun 05 17:58:47.797406 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.797379 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:47.895708 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.895672 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-bundle\") pod \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " Jun 05 17:58:47.895866 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.895751 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xdkp\" (UniqueName: \"kubernetes.io/projected/3602c13d-e172-4ffe-9eb1-cf8917b643a7-kube-api-access-7xdkp\") pod \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " Jun 05 17:58:47.895866 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.895800 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-util\") pod \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\" (UID: \"3602c13d-e172-4ffe-9eb1-cf8917b643a7\") " Jun 05 17:58:47.896377 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.896345 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-bundle" (OuterVolumeSpecName: "bundle") pod "3602c13d-e172-4ffe-9eb1-cf8917b643a7" (UID: "3602c13d-e172-4ffe-9eb1-cf8917b643a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:47.897929 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.897895 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3602c13d-e172-4ffe-9eb1-cf8917b643a7-kube-api-access-7xdkp" (OuterVolumeSpecName: "kube-api-access-7xdkp") pod "3602c13d-e172-4ffe-9eb1-cf8917b643a7" (UID: "3602c13d-e172-4ffe-9eb1-cf8917b643a7"). InnerVolumeSpecName "kube-api-access-7xdkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:58:47.901270 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.901236 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-util" (OuterVolumeSpecName: "util") pod "3602c13d-e172-4ffe-9eb1-cf8917b643a7" (UID: "3602c13d-e172-4ffe-9eb1-cf8917b643a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:58:47.997101 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.996993 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-util\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:47.997101 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.997040 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3602c13d-e172-4ffe-9eb1-cf8917b643a7-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:47.997101 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:47.997050 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xdkp\" (UniqueName: \"kubernetes.io/projected/3602c13d-e172-4ffe-9eb1-cf8917b643a7-kube-api-access-7xdkp\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:58:48.674456 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:48.674426 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" Jun 05 17:58:48.674881 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:48.674428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx" event={"ID":"3602c13d-e172-4ffe-9eb1-cf8917b643a7","Type":"ContainerDied","Data":"dfe17cbbae27bba957a4b424941cd6bd027769d22419e391102690d785cdc339"} Jun 05 17:58:48.674881 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:58:48.674554 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfe17cbbae27bba957a4b424941cd6bd027769d22419e391102690d785cdc339" Jun 05 17:59:04.925325 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925284 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k"] Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925750 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925768 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925780 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925786 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925792 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925798 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925810 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925815 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925822 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925827 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925835 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925840 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925846 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925850 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925856 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925861 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925868 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925875 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="util" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925885 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925890 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="pull" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925897 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925903 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925911 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925916 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925973 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3602c13d-e172-4ffe-9eb1-cf8917b643a7" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925981 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1a066d-4878-4523-b407-5fb537c517f6" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925990 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="641ba905-3e16-4d29-aade-ead2053e36e0" containerName="extract" Jun 05 17:59:04.927936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.925997 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="98da461f-fb8a-4a16-a799-594bdf330586" containerName="extract" Jun 05 17:59:04.928916 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.928898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:04.932536 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.932516 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v85fv\"" Jun 05 17:59:04.940996 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.940962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e29afcf-84a1-4f12-8dab-9e23433c1ead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:04.941127 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.941033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z28sj\" (UniqueName: \"kubernetes.io/projected/5e29afcf-84a1-4f12-8dab-9e23433c1ead-kube-api-access-z28sj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:04.941619 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:04.941601 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k"] Jun 05 17:59:05.042450 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.042413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e29afcf-84a1-4f12-8dab-9e23433c1ead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:05.042662 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.042462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z28sj\" (UniqueName: \"kubernetes.io/projected/5e29afcf-84a1-4f12-8dab-9e23433c1ead-kube-api-access-z28sj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:05.042840 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.042811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e29afcf-84a1-4f12-8dab-9e23433c1ead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:05.061126 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.061094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z28sj\" (UniqueName: \"kubernetes.io/projected/5e29afcf-84a1-4f12-8dab-9e23433c1ead-kube-api-access-z28sj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:05.238581 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.238490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:05.373924 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.373900 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k"] Jun 05 17:59:05.376203 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:59:05.376178 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e29afcf_84a1_4f12_8dab_9e23433c1ead.slice/crio-673e98e1f9b88e5a33052236ee63a395e4301ee917537238a4faeacce4d6397e WatchSource:0}: Error finding container 673e98e1f9b88e5a33052236ee63a395e4301ee917537238a4faeacce4d6397e: Status 404 returned error can't find the container with id 673e98e1f9b88e5a33052236ee63a395e4301ee917537238a4faeacce4d6397e Jun 05 17:59:05.754039 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:05.754004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" event={"ID":"5e29afcf-84a1-4f12-8dab-9e23433c1ead","Type":"ContainerStarted","Data":"673e98e1f9b88e5a33052236ee63a395e4301ee917537238a4faeacce4d6397e"} Jun 05 17:59:08.692764 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.692674 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7"] Jun 05 17:59:08.696179 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.696155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:08.698571 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.698547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bp9dm\"" Jun 05 17:59:08.706220 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.706197 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7"] Jun 05 17:59:08.776548 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.776514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw5gw\" (UniqueName: \"kubernetes.io/projected/2f101a8d-d421-4f4d-aba6-46692bd563c3-kube-api-access-nw5gw\") pod \"authorino-operator-75cc8d5cb7-zfnj7\" (UID: \"2f101a8d-d421-4f4d-aba6-46692bd563c3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:08.877148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.877109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw5gw\" (UniqueName: \"kubernetes.io/projected/2f101a8d-d421-4f4d-aba6-46692bd563c3-kube-api-access-nw5gw\") pod \"authorino-operator-75cc8d5cb7-zfnj7\" (UID: \"2f101a8d-d421-4f4d-aba6-46692bd563c3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:08.888050 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:08.888015 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw5gw\" (UniqueName: \"kubernetes.io/projected/2f101a8d-d421-4f4d-aba6-46692bd563c3-kube-api-access-nw5gw\") pod \"authorino-operator-75cc8d5cb7-zfnj7\" (UID: \"2f101a8d-d421-4f4d-aba6-46692bd563c3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:09.009177 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:09.009081 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:09.151702 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:09.151672 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7"] Jun 05 17:59:09.154179 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:59:09.154147 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f101a8d_d421_4f4d_aba6_46692bd563c3.slice/crio-4b8449771e59f8931fc8ef7fcfec7b6379e5bce788a2459bb6534043115f8a64 WatchSource:0}: Error finding container 4b8449771e59f8931fc8ef7fcfec7b6379e5bce788a2459bb6534043115f8a64: Status 404 returned error can't find the container with id 4b8449771e59f8931fc8ef7fcfec7b6379e5bce788a2459bb6534043115f8a64 Jun 05 17:59:09.775920 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:09.775867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" event={"ID":"2f101a8d-d421-4f4d-aba6-46692bd563c3","Type":"ContainerStarted","Data":"4b8449771e59f8931fc8ef7fcfec7b6379e5bce788a2459bb6534043115f8a64"} Jun 05 17:59:10.783143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:10.783050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" event={"ID":"5e29afcf-84a1-4f12-8dab-9e23433c1ead","Type":"ContainerStarted","Data":"18264dbbdf2899a52dfcab6cede18a258968908548166efa86bda52fffaa7742"} Jun 05 17:59:10.783143 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:10.783132 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:10.807086 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:10.807004 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" podStartSLOduration=1.7834961200000001 podStartE2EDuration="6.806984071s" totalImagesPullingTime="5.023487951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:10.805094909 +0000 UTC m=+612.833829830" watchObservedRunningTime="2026-06-05 17:59:10.806984071 +0000 UTC m=+612.835718993" Jun 05 17:59:12.794067 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:12.794030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" event={"ID":"2f101a8d-d421-4f4d-aba6-46692bd563c3","Type":"ContainerStarted","Data":"e79517999bfaf206716eb201fae931343603925d90bb5aa3f89efb32763c0c90"} Jun 05 17:59:12.794526 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:12.794139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:12.812983 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:12.812931 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" podStartSLOduration=1.888267172 podStartE2EDuration="4.812913665s" totalImagesPullingTime="2.924646493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:12.811667742 +0000 UTC m=+614.840402663" watchObservedRunningTime="2026-06-05 17:59:12.812913665 +0000 UTC m=+614.841648584" Jun 05 17:59:21.790642 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:21.790599 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:23.715180 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.715135 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k"] Jun 05 17:59:23.715692 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.715419 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" containerName="manager" containerID="cri-o://18264dbbdf2899a52dfcab6cede18a258968908548166efa86bda52fffaa7742" gracePeriod=2 Jun 05 17:59:23.717125 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.717102 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k"] Jun 05 17:59:23.717964 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:59:23.717929 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:23.739289 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.739257 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x"] Jun 05 17:59:23.739815 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.739793 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" containerName="manager" Jun 05 17:59:23.739815 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.739820 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" containerName="manager" Jun 05 17:59:23.739951 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.739913 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" containerName="manager" Jun 05 17:59:23.743396 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.743367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.745718 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:59:23.745683 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:23.755198 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.755176 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x"] Jun 05 17:59:23.801460 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.801428 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zfnj7" Jun 05 17:59:23.803812 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:59:23.803781 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:23.808264 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.808239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h888g\" (UniqueName: \"kubernetes.io/projected/6747c603-8751-4b69-aa87-2403c15396a3-kube-api-access-h888g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6p69x\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.808396 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.808302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6747c603-8751-4b69-aa87-2403c15396a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6p69x\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.850397 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.850347 2579 generic.go:356] "Generic (PLEG): container finished" podID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" containerID="18264dbbdf2899a52dfcab6cede18a258968908548166efa86bda52fffaa7742" exitCode=0 Jun 05 17:59:23.909206 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.909171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h888g\" (UniqueName: \"kubernetes.io/projected/6747c603-8751-4b69-aa87-2403c15396a3-kube-api-access-h888g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6p69x\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.909373 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.909250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6747c603-8751-4b69-aa87-2403c15396a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6p69x\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.909707 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.909686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6747c603-8751-4b69-aa87-2403c15396a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6p69x\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.918857 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.918827 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h888g\" (UniqueName: \"kubernetes.io/projected/6747c603-8751-4b69-aa87-2403c15396a3-kube-api-access-h888g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6p69x\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:23.964514 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:23.964486 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:23.967233 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:59:23.967171 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvt6k\" is forbidden: User \"system:node:ip-10-0-128-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-168.ec2.internal' and this object" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:24.010539 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.010499 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e29afcf-84a1-4f12-8dab-9e23433c1ead-extensions-socket-volume\") pod \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " Jun 05 17:59:24.010714 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.010570 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z28sj\" (UniqueName: \"kubernetes.io/projected/5e29afcf-84a1-4f12-8dab-9e23433c1ead-kube-api-access-z28sj\") pod \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\" (UID: \"5e29afcf-84a1-4f12-8dab-9e23433c1ead\") " Jun 05 17:59:24.011011 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.010979 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e29afcf-84a1-4f12-8dab-9e23433c1ead-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5e29afcf-84a1-4f12-8dab-9e23433c1ead" (UID: "5e29afcf-84a1-4f12-8dab-9e23433c1ead"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:59:24.012668 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.012637 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e29afcf-84a1-4f12-8dab-9e23433c1ead-kube-api-access-z28sj" (OuterVolumeSpecName: "kube-api-access-z28sj") pod "5e29afcf-84a1-4f12-8dab-9e23433c1ead" (UID: "5e29afcf-84a1-4f12-8dab-9e23433c1ead"). InnerVolumeSpecName "kube-api-access-z28sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:59:24.098008 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.097951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:24.111397 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.111373 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e29afcf-84a1-4f12-8dab-9e23433c1ead-extensions-socket-volume\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:59:24.111397 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.111397 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z28sj\" (UniqueName: \"kubernetes.io/projected/5e29afcf-84a1-4f12-8dab-9e23433c1ead-kube-api-access-z28sj\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:59:24.239703 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.239677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x"] Jun 05 17:59:24.242543 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:59:24.242515 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6747c603_8751_4b69_aa87_2403c15396a3.slice/crio-f30eca6892000812994c79cdd96455643ea2d65b3323dd7492e5741f3cda75e6 WatchSource:0}: Error finding container f30eca6892000812994c79cdd96455643ea2d65b3323dd7492e5741f3cda75e6: Status 404 returned error can't find the container with id f30eca6892000812994c79cdd96455643ea2d65b3323dd7492e5741f3cda75e6 Jun 05 17:59:24.426306 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.426270 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e29afcf-84a1-4f12-8dab-9e23433c1ead" path="/var/lib/kubelet/pods/5e29afcf-84a1-4f12-8dab-9e23433c1ead/volumes" Jun 05 17:59:24.856432 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.856393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" event={"ID":"6747c603-8751-4b69-aa87-2403c15396a3","Type":"ContainerStarted","Data":"2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f"} Jun 05 17:59:24.856897 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.856459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:24.856897 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.856482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" event={"ID":"6747c603-8751-4b69-aa87-2403c15396a3","Type":"ContainerStarted","Data":"f30eca6892000812994c79cdd96455643ea2d65b3323dd7492e5741f3cda75e6"} Jun 05 17:59:24.857680 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.857666 2579 scope.go:117] "RemoveContainer" containerID="18264dbbdf2899a52dfcab6cede18a258968908548166efa86bda52fffaa7742" Jun 05 17:59:24.857781 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.857748 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvt6k" Jun 05 17:59:24.902754 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:24.902703 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" podStartSLOduration=1.902688007 podStartE2EDuration="1.902688007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:24.902166738 +0000 UTC m=+626.930901671" watchObservedRunningTime="2026-06-05 17:59:24.902688007 +0000 UTC m=+626.931422927" Jun 05 17:59:35.866749 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:35.866716 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:40.375126 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.375085 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x"] Jun 05 17:59:40.375557 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.375310 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" podUID="6747c603-8751-4b69-aa87-2403c15396a3" containerName="manager" containerID="cri-o://2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f" gracePeriod=10 Jun 05 17:59:40.629144 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.629082 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:40.756071 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.756040 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h888g\" (UniqueName: \"kubernetes.io/projected/6747c603-8751-4b69-aa87-2403c15396a3-kube-api-access-h888g\") pod \"6747c603-8751-4b69-aa87-2403c15396a3\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " Jun 05 17:59:40.756252 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.756093 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6747c603-8751-4b69-aa87-2403c15396a3-extensions-socket-volume\") pod \"6747c603-8751-4b69-aa87-2403c15396a3\" (UID: \"6747c603-8751-4b69-aa87-2403c15396a3\") " Jun 05 17:59:40.756520 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.756498 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6747c603-8751-4b69-aa87-2403c15396a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6747c603-8751-4b69-aa87-2403c15396a3" (UID: "6747c603-8751-4b69-aa87-2403c15396a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:59:40.758191 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.758167 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6747c603-8751-4b69-aa87-2403c15396a3-kube-api-access-h888g" (OuterVolumeSpecName: "kube-api-access-h888g") pod "6747c603-8751-4b69-aa87-2403c15396a3" (UID: "6747c603-8751-4b69-aa87-2403c15396a3"). InnerVolumeSpecName "kube-api-access-h888g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:59:40.857001 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.856958 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h888g\" (UniqueName: \"kubernetes.io/projected/6747c603-8751-4b69-aa87-2403c15396a3-kube-api-access-h888g\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:59:40.857001 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.856997 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6747c603-8751-4b69-aa87-2403c15396a3-extensions-socket-volume\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 17:59:40.940071 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.939988 2579 generic.go:356] "Generic (PLEG): container finished" podID="6747c603-8751-4b69-aa87-2403c15396a3" containerID="2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f" exitCode=0 Jun 05 17:59:40.940071 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.940037 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" Jun 05 17:59:40.940244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.940072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" event={"ID":"6747c603-8751-4b69-aa87-2403c15396a3","Type":"ContainerDied","Data":"2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f"} Jun 05 17:59:40.940244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.940126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x" event={"ID":"6747c603-8751-4b69-aa87-2403c15396a3","Type":"ContainerDied","Data":"f30eca6892000812994c79cdd96455643ea2d65b3323dd7492e5741f3cda75e6"} Jun 05 17:59:40.940244 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.940150 2579 scope.go:117] "RemoveContainer" containerID="2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f" Jun 05 17:59:40.949850 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.949834 2579 scope.go:117] "RemoveContainer" containerID="2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f" Jun 05 17:59:40.950085 ip-10-0-128-168 kubenswrapper[2579]: E0605 17:59:40.950067 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f\": container with ID starting with 2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f not found: ID does not exist" containerID="2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f" Jun 05 17:59:40.950146 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.950093 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f"} err="failed to get container status \"2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f\": rpc error: code = NotFound desc = could not find container \"2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f\": container with ID starting with 2a6d9cbbe08ae8d2991c1ec72f1fb8300a7e89faa8fdf637bbdcc04fb295642f not found: ID does not exist" Jun 05 17:59:40.962340 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.962319 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x"] Jun 05 17:59:40.969093 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:40.969073 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6p69x"] Jun 05 17:59:42.431319 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:42.431276 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6747c603-8751-4b69-aa87-2403c15396a3" path="/var/lib/kubelet/pods/6747c603-8751-4b69-aa87-2403c15396a3/volumes" Jun 05 17:59:56.612795 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.612757 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt"] Jun 05 17:59:56.613298 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.613097 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6747c603-8751-4b69-aa87-2403c15396a3" containerName="manager" Jun 05 17:59:56.613298 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.613111 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6747c603-8751-4b69-aa87-2403c15396a3" containerName="manager" Jun 05 17:59:56.613298 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.613175 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6747c603-8751-4b69-aa87-2403c15396a3" containerName="manager" Jun 05 17:59:56.617774 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.617755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.622110 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.622088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9smr6\"" Jun 05 17:59:56.634178 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.634153 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt"] Jun 05 17:59:56.700870 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.700836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw8xq\" (UniqueName: \"kubernetes.io/projected/ba18d7ea-dcbe-465c-b1d7-804677a19df9-kube-api-access-qw8xq\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.700870 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.700873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701076 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.700898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701076 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.700919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701076 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.700950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701076 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.700966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701076 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.701028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701076 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.701063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.701269 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.701089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.801611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.801611 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.801845 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801760 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.801845 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.801936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.801936 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802039 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801971 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802039 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.801991 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.802036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.802108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw8xq\" (UniqueName: \"kubernetes.io/projected/ba18d7ea-dcbe-465c-b1d7-804677a19df9-kube-api-access-qw8xq\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802148 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.802139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802297 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.802231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802389 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.802368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.802746 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.802725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.804150 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.804124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.804344 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.804327 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.809840 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.809819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba18d7ea-dcbe-465c-b1d7-804677a19df9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.810013 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.809996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw8xq\" (UniqueName: \"kubernetes.io/projected/ba18d7ea-dcbe-465c-b1d7-804677a19df9-kube-api-access-qw8xq\") pod \"maas-default-gateway-openshift-default-687ff6996-nkhlt\" (UID: \"ba18d7ea-dcbe-465c-b1d7-804677a19df9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:56.928464 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:56.928370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:57.064466 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:57.064436 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt"] Jun 05 17:59:57.067676 ip-10-0-128-168 kubenswrapper[2579]: W0605 17:59:57.067648 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba18d7ea_dcbe_465c_b1d7_804677a19df9.slice/crio-e7c9f3694581c77f1f25fa0406b9b254ee9d0762819110cd82bdd00f0ae68946 WatchSource:0}: Error finding container e7c9f3694581c77f1f25fa0406b9b254ee9d0762819110cd82bdd00f0ae68946: Status 404 returned error can't find the container with id e7c9f3694581c77f1f25fa0406b9b254ee9d0762819110cd82bdd00f0ae68946 Jun 05 17:59:57.069792 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:57.069761 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 17:59:57.069881 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:57.069829 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 17:59:57.069881 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:57.069864 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 17:59:58.026447 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:58.026413 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" event={"ID":"ba18d7ea-dcbe-465c-b1d7-804677a19df9","Type":"ContainerStarted","Data":"f941ff2363dec8d3ec1b9f42479ca9e5977c6879500a5f831f5f702f5b40462a"} Jun 05 17:59:58.026853 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:58.026462 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" event={"ID":"ba18d7ea-dcbe-465c-b1d7-804677a19df9","Type":"ContainerStarted","Data":"e7c9f3694581c77f1f25fa0406b9b254ee9d0762819110cd82bdd00f0ae68946"} Jun 05 17:59:58.047409 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:58.047349 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" podStartSLOduration=2.047330772 podStartE2EDuration="2.047330772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:58.046663603 +0000 UTC m=+660.075398523" watchObservedRunningTime="2026-06-05 17:59:58.047330772 +0000 UTC m=+660.076065692" Jun 05 17:59:58.928965 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:58.928923 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:58.933921 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:58.933893 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:59.031512 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:59.031485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 17:59:59.032535 ip-10-0-128-168 kubenswrapper[2579]: I0605 17:59:59.032513 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 18:00:00.955496 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:00.955459 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:00.958591 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:00.958571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:00.961835 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:00.961813 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j2czf\"" Jun 05 18:00:00.962151 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:00.962136 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 18:00:00.975967 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:00.975942 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:01.039027 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.038993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwk76\" (UniqueName: \"kubernetes.io/projected/63539bfa-2445-4c30-947b-666a53e3c05c-kube-api-access-mwk76\") pod \"limitador-limitador-64c94fd64f-pvbq9\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.039248 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.039093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63539bfa-2445-4c30-947b-666a53e3c05c-config-file\") pod \"limitador-limitador-64c94fd64f-pvbq9\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.053853 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.053822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:01.139477 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.139446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwk76\" (UniqueName: \"kubernetes.io/projected/63539bfa-2445-4c30-947b-666a53e3c05c-kube-api-access-mwk76\") pod \"limitador-limitador-64c94fd64f-pvbq9\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.139674 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.139518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63539bfa-2445-4c30-947b-666a53e3c05c-config-file\") pod \"limitador-limitador-64c94fd64f-pvbq9\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.140316 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.140291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63539bfa-2445-4c30-947b-666a53e3c05c-config-file\") pod \"limitador-limitador-64c94fd64f-pvbq9\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.148500 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.148448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwk76\" (UniqueName: \"kubernetes.io/projected/63539bfa-2445-4c30-947b-666a53e3c05c-kube-api-access-mwk76\") pod \"limitador-limitador-64c94fd64f-pvbq9\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.269295 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.269204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:01.417481 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.417457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:01.419201 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:00:01.419172 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63539bfa_2445_4c30_947b_666a53e3c05c.slice/crio-016413fdad446abe0a65a08cbad4b9a5509f431da8aca3c3aab30db33ce77203 WatchSource:0}: Error finding container 016413fdad446abe0a65a08cbad4b9a5509f431da8aca3c3aab30db33ce77203: Status 404 returned error can't find the container with id 016413fdad446abe0a65a08cbad4b9a5509f431da8aca3c3aab30db33ce77203 Jun 05 18:00:01.765151 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.765114 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-frbgx"] Jun 05 18:00:01.768078 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.768060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:01.770678 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.770653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6cks\"" Jun 05 18:00:01.776559 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.776531 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-frbgx"] Jun 05 18:00:01.845526 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.845487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4f7h\" (UniqueName: \"kubernetes.io/projected/d66c84a7-7f59-4147-9bf8-5864091e15e7-kube-api-access-h4f7h\") pod \"authorino-58cd955675-frbgx\" (UID: \"d66c84a7-7f59-4147-9bf8-5864091e15e7\") " pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:01.946971 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.946934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4f7h\" (UniqueName: \"kubernetes.io/projected/d66c84a7-7f59-4147-9bf8-5864091e15e7-kube-api-access-h4f7h\") pod \"authorino-58cd955675-frbgx\" (UID: \"d66c84a7-7f59-4147-9bf8-5864091e15e7\") " pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:01.958258 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:01.958225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4f7h\" (UniqueName: \"kubernetes.io/projected/d66c84a7-7f59-4147-9bf8-5864091e15e7-kube-api-access-h4f7h\") pod \"authorino-58cd955675-frbgx\" (UID: \"d66c84a7-7f59-4147-9bf8-5864091e15e7\") " pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:02.050994 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:02.050908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" event={"ID":"63539bfa-2445-4c30-947b-666a53e3c05c","Type":"ContainerStarted","Data":"016413fdad446abe0a65a08cbad4b9a5509f431da8aca3c3aab30db33ce77203"} Jun 05 18:00:02.079304 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:02.079213 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:02.280026 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:02.279943 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-frbgx"] Jun 05 18:00:02.285175 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:00:02.285139 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd66c84a7_7f59_4147_9bf8_5864091e15e7.slice/crio-13d4032457f2837ffd118e0597413fad49d68b27d60ad6487d02fcf4932dcf08 WatchSource:0}: Error finding container 13d4032457f2837ffd118e0597413fad49d68b27d60ad6487d02fcf4932dcf08: Status 404 returned error can't find the container with id 13d4032457f2837ffd118e0597413fad49d68b27d60ad6487d02fcf4932dcf08 Jun 05 18:00:03.060552 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:03.060510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-frbgx" event={"ID":"d66c84a7-7f59-4147-9bf8-5864091e15e7","Type":"ContainerStarted","Data":"13d4032457f2837ffd118e0597413fad49d68b27d60ad6487d02fcf4932dcf08"} Jun 05 18:00:06.079420 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:06.079375 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-frbgx" event={"ID":"d66c84a7-7f59-4147-9bf8-5864091e15e7","Type":"ContainerStarted","Data":"bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3"} Jun 05 18:00:06.081103 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:06.081075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" event={"ID":"63539bfa-2445-4c30-947b-666a53e3c05c","Type":"ContainerStarted","Data":"a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0"} Jun 05 18:00:06.081251 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:06.081133 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:06.097757 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:06.097704 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-frbgx" podStartSLOduration=1.407386857 podStartE2EDuration="5.097687444s" totalImagesPullingTime="3.690300587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:00:06.096264714 +0000 UTC m=+668.124999635" watchObservedRunningTime="2026-06-05 18:00:06.097687444 +0000 UTC m=+668.126422377" Jun 05 18:00:06.820413 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:06.820356 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" podStartSLOduration=2.308965211 podStartE2EDuration="6.820335792s" totalImagesPullingTime="4.511370581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:00:06.120264386 +0000 UTC m=+668.148999300" watchObservedRunningTime="2026-06-05 18:00:06.820335792 +0000 UTC m=+668.849070712" Jun 05 18:00:06.820723 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:06.820706 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-frbgx"] Jun 05 18:00:08.089944 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:08.089908 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-frbgx" podUID="d66c84a7-7f59-4147-9bf8-5864091e15e7" containerName="authorino" containerID="cri-o://bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3" gracePeriod=30 Jun 05 18:00:08.342289 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:08.342221 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:08.410571 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:08.410532 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4f7h\" (UniqueName: \"kubernetes.io/projected/d66c84a7-7f59-4147-9bf8-5864091e15e7-kube-api-access-h4f7h\") pod \"d66c84a7-7f59-4147-9bf8-5864091e15e7\" (UID: \"d66c84a7-7f59-4147-9bf8-5864091e15e7\") " Jun 05 18:00:08.412663 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:08.412618 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66c84a7-7f59-4147-9bf8-5864091e15e7-kube-api-access-h4f7h" (OuterVolumeSpecName: "kube-api-access-h4f7h") pod "d66c84a7-7f59-4147-9bf8-5864091e15e7" (UID: "d66c84a7-7f59-4147-9bf8-5864091e15e7"). InnerVolumeSpecName "kube-api-access-h4f7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:00:08.512122 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:08.512083 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4f7h\" (UniqueName: \"kubernetes.io/projected/d66c84a7-7f59-4147-9bf8-5864091e15e7-kube-api-access-h4f7h\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:00:09.095773 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.095739 2579 generic.go:356] "Generic (PLEG): container finished" podID="d66c84a7-7f59-4147-9bf8-5864091e15e7" containerID="bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3" exitCode=0 Jun 05 18:00:09.096186 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.095779 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-frbgx" Jun 05 18:00:09.096186 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.095828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-frbgx" event={"ID":"d66c84a7-7f59-4147-9bf8-5864091e15e7","Type":"ContainerDied","Data":"bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3"} Jun 05 18:00:09.096186 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.095873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-frbgx" event={"ID":"d66c84a7-7f59-4147-9bf8-5864091e15e7","Type":"ContainerDied","Data":"13d4032457f2837ffd118e0597413fad49d68b27d60ad6487d02fcf4932dcf08"} Jun 05 18:00:09.096186 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.095890 2579 scope.go:117] "RemoveContainer" containerID="bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3" Jun 05 18:00:09.104591 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.104576 2579 scope.go:117] "RemoveContainer" containerID="bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3" Jun 05 18:00:09.104911 ip-10-0-128-168 kubenswrapper[2579]: E0605 18:00:09.104894 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3\": container with ID starting with bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3 not found: ID does not exist" containerID="bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3" Jun 05 18:00:09.104962 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.104918 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3"} err="failed to get container status \"bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3\": rpc error: code = NotFound desc = could not find container \"bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3\": container with ID starting with bc6241fae57d6f17277f8ea1620f205ec73505080991ea8181ca7918c87223c3 not found: ID does not exist" Jun 05 18:00:09.115701 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.115679 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-frbgx"] Jun 05 18:00:09.120601 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:09.120577 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-frbgx"] Jun 05 18:00:10.426297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:10.426263 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66c84a7-7f59-4147-9bf8-5864091e15e7" path="/var/lib/kubelet/pods/d66c84a7-7f59-4147-9bf8-5864091e15e7/volumes" Jun 05 18:00:15.801243 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:15.801209 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:15.801704 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:15.801382 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" podUID="63539bfa-2445-4c30-947b-666a53e3c05c" containerName="limitador" containerID="cri-o://a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0" gracePeriod=30 Jun 05 18:00:15.802177 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:15.802158 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:16.357659 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.357591 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:16.483872 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.483828 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63539bfa-2445-4c30-947b-666a53e3c05c-config-file\") pod \"63539bfa-2445-4c30-947b-666a53e3c05c\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " Jun 05 18:00:16.484034 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.483933 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwk76\" (UniqueName: \"kubernetes.io/projected/63539bfa-2445-4c30-947b-666a53e3c05c-kube-api-access-mwk76\") pod \"63539bfa-2445-4c30-947b-666a53e3c05c\" (UID: \"63539bfa-2445-4c30-947b-666a53e3c05c\") " Jun 05 18:00:16.484234 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.484205 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63539bfa-2445-4c30-947b-666a53e3c05c-config-file" (OuterVolumeSpecName: "config-file") pod "63539bfa-2445-4c30-947b-666a53e3c05c" (UID: "63539bfa-2445-4c30-947b-666a53e3c05c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 18:00:16.486194 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.486138 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63539bfa-2445-4c30-947b-666a53e3c05c-kube-api-access-mwk76" (OuterVolumeSpecName: "kube-api-access-mwk76") pod "63539bfa-2445-4c30-947b-666a53e3c05c" (UID: "63539bfa-2445-4c30-947b-666a53e3c05c"). InnerVolumeSpecName "kube-api-access-mwk76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:00:16.585332 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.585292 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63539bfa-2445-4c30-947b-666a53e3c05c-config-file\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:00:16.585332 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:16.585325 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwk76\" (UniqueName: \"kubernetes.io/projected/63539bfa-2445-4c30-947b-666a53e3c05c-kube-api-access-mwk76\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:00:17.139705 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.139671 2579 generic.go:356] "Generic (PLEG): container finished" podID="63539bfa-2445-4c30-947b-666a53e3c05c" containerID="a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0" exitCode=0 Jun 05 18:00:17.140122 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.139724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" event={"ID":"63539bfa-2445-4c30-947b-666a53e3c05c","Type":"ContainerDied","Data":"a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0"} Jun 05 18:00:17.140122 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.139733 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" Jun 05 18:00:17.140122 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.139766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pvbq9" event={"ID":"63539bfa-2445-4c30-947b-666a53e3c05c","Type":"ContainerDied","Data":"016413fdad446abe0a65a08cbad4b9a5509f431da8aca3c3aab30db33ce77203"} Jun 05 18:00:17.140122 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.139789 2579 scope.go:117] "RemoveContainer" containerID="a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0" Jun 05 18:00:17.148525 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.148498 2579 scope.go:117] "RemoveContainer" containerID="a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0" Jun 05 18:00:17.149034 ip-10-0-128-168 kubenswrapper[2579]: E0605 18:00:17.148853 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0\": container with ID starting with a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0 not found: ID does not exist" containerID="a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0" Jun 05 18:00:17.149034 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.148891 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0"} err="failed to get container status \"a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0\": rpc error: code = NotFound desc = could not find container \"a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0\": container with ID starting with a5ba0178b4eab9cd3abefc6726c422cff75e7cfa0d72f596e597d4196ca2a9a0 not found: ID does not exist" Jun 05 18:00:17.164099 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.164070 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:17.171010 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:17.170985 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pvbq9"] Jun 05 18:00:18.426441 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:18.426406 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63539bfa-2445-4c30-947b-666a53e3c05c" path="/var/lib/kubelet/pods/63539bfa-2445-4c30-947b-666a53e3c05c/volumes" Jun 05 18:00:21.927619 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.927583 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-g54x6"] Jun 05 18:00:21.928070 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.928005 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66c84a7-7f59-4147-9bf8-5864091e15e7" containerName="authorino" Jun 05 18:00:21.928070 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.928021 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66c84a7-7f59-4147-9bf8-5864091e15e7" containerName="authorino" Jun 05 18:00:21.928070 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.928030 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63539bfa-2445-4c30-947b-666a53e3c05c" containerName="limitador" Jun 05 18:00:21.928070 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.928035 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63539bfa-2445-4c30-947b-666a53e3c05c" containerName="limitador" Jun 05 18:00:21.928194 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.928095 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63539bfa-2445-4c30-947b-666a53e3c05c" containerName="limitador" Jun 05 18:00:21.928194 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.928102 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66c84a7-7f59-4147-9bf8-5864091e15e7" containerName="authorino" Jun 05 18:00:21.932391 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.932375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:21.934896 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.934869 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 05 18:00:21.937972 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:21.937946 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-g54x6"] Jun 05 18:00:22.029914 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.029875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzh2\" (UniqueName: \"kubernetes.io/projected/70e684bc-8e25-4915-afcc-854d02c79869-kube-api-access-cbzh2\") pod \"postgres-69fb4594cf-g54x6\" (UID: \"70e684bc-8e25-4915-afcc-854d02c79869\") " pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.030106 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.029996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70e684bc-8e25-4915-afcc-854d02c79869-data\") pod \"postgres-69fb4594cf-g54x6\" (UID: \"70e684bc-8e25-4915-afcc-854d02c79869\") " pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.131010 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.130966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzh2\" (UniqueName: \"kubernetes.io/projected/70e684bc-8e25-4915-afcc-854d02c79869-kube-api-access-cbzh2\") pod \"postgres-69fb4594cf-g54x6\" (UID: \"70e684bc-8e25-4915-afcc-854d02c79869\") " pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.131192 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.131023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70e684bc-8e25-4915-afcc-854d02c79869-data\") pod \"postgres-69fb4594cf-g54x6\" (UID: \"70e684bc-8e25-4915-afcc-854d02c79869\") " pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.131389 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.131373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70e684bc-8e25-4915-afcc-854d02c79869-data\") pod \"postgres-69fb4594cf-g54x6\" (UID: \"70e684bc-8e25-4915-afcc-854d02c79869\") " pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.139739 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.139714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzh2\" (UniqueName: \"kubernetes.io/projected/70e684bc-8e25-4915-afcc-854d02c79869-kube-api-access-cbzh2\") pod \"postgres-69fb4594cf-g54x6\" (UID: \"70e684bc-8e25-4915-afcc-854d02c79869\") " pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.244077 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.243998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:22.386832 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:22.386800 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-g54x6"] Jun 05 18:00:22.388916 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:00:22.388890 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e684bc_8e25_4915_afcc_854d02c79869.slice/crio-6dc583abe73a324a5a96b7bfdb118f9f4cab0c5da9bdce45299ff314eab8645c WatchSource:0}: Error finding container 6dc583abe73a324a5a96b7bfdb118f9f4cab0c5da9bdce45299ff314eab8645c: Status 404 returned error can't find the container with id 6dc583abe73a324a5a96b7bfdb118f9f4cab0c5da9bdce45299ff314eab8645c Jun 05 18:00:23.170446 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:23.170410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-g54x6" event={"ID":"70e684bc-8e25-4915-afcc-854d02c79869","Type":"ContainerStarted","Data":"6dc583abe73a324a5a96b7bfdb118f9f4cab0c5da9bdce45299ff314eab8645c"} Jun 05 18:00:25.181661 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:25.181561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-g54x6" event={"ID":"70e684bc-8e25-4915-afcc-854d02c79869","Type":"ContainerStarted","Data":"e33892456909287b4f42107e1526d87938935d12f4d8238c9e920f2f9ded6d0c"} Jun 05 18:00:25.182075 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:25.181783 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:25.198028 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:25.197972 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-g54x6" podStartSLOduration=1.6658017520000001 podStartE2EDuration="4.197952691s" totalImagesPullingTime="2.532150939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:00:25.19783598 +0000 UTC m=+687.226570902" watchObservedRunningTime="2026-06-05 18:00:25.197952691 +0000 UTC m=+687.226687612" Jun 05 18:00:31.217924 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:31.217893 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-g54x6" Jun 05 18:00:32.653749 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.653712 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc"] Jun 05 18:00:32.657352 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.657334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.659994 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.659972 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 18:00:32.660102 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.660019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b8ngf\"" Jun 05 18:00:32.661048 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.661032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 18:00:32.665983 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.665963 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc"] Jun 05 18:00:32.825080 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.825041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.825080 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.825084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.825318 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.825206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvlz\" (UniqueName: \"kubernetes.io/projected/a976ac9f-d074-4712-ac0e-dd904bf072af-kube-api-access-bzvlz\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.926132 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.926049 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.926261 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.926139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvlz\" (UniqueName: \"kubernetes.io/projected/a976ac9f-d074-4712-ac0e-dd904bf072af-kube-api-access-bzvlz\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.926261 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.926180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.926522 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.926506 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.926558 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.926504 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.938428 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.938397 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvlz\" (UniqueName: \"kubernetes.io/projected/a976ac9f-d074-4712-ac0e-dd904bf072af-kube-api-access-bzvlz\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:32.968105 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:32.968077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:33.096547 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:33.096502 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc"] Jun 05 18:00:33.098967 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:00:33.098940 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda976ac9f_d074_4712_ac0e_dd904bf072af.slice/crio-90dfa96c2ec7e787138de2e59ce4b38f382479c33ce9e7f57b8b0b65100a5c77 WatchSource:0}: Error finding container 90dfa96c2ec7e787138de2e59ce4b38f382479c33ce9e7f57b8b0b65100a5c77: Status 404 returned error can't find the container with id 90dfa96c2ec7e787138de2e59ce4b38f382479c33ce9e7f57b8b0b65100a5c77 Jun 05 18:00:33.223064 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:33.223025 2579 generic.go:356] "Generic (PLEG): container finished" podID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerID="472dc05bb90bee8689ad295291b9ee0a01fab12f18e1583abc860b2bbe73afa9" exitCode=0 Jun 05 18:00:33.223239 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:33.223109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" event={"ID":"a976ac9f-d074-4712-ac0e-dd904bf072af","Type":"ContainerDied","Data":"472dc05bb90bee8689ad295291b9ee0a01fab12f18e1583abc860b2bbe73afa9"} Jun 05 18:00:33.223239 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:33.223157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" event={"ID":"a976ac9f-d074-4712-ac0e-dd904bf072af","Type":"ContainerStarted","Data":"90dfa96c2ec7e787138de2e59ce4b38f382479c33ce9e7f57b8b0b65100a5c77"} Jun 05 18:00:34.230093 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:34.230007 2579 generic.go:356] "Generic (PLEG): container finished" podID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerID="8c587ec0040718d1df01a8b809f24e93b5e45784c26b03659780e3b3616c4215" exitCode=0 Jun 05 18:00:34.230443 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:34.230088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" event={"ID":"a976ac9f-d074-4712-ac0e-dd904bf072af","Type":"ContainerDied","Data":"8c587ec0040718d1df01a8b809f24e93b5e45784c26b03659780e3b3616c4215"} Jun 05 18:00:35.237556 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:35.237519 2579 generic.go:356] "Generic (PLEG): container finished" podID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerID="279bf6ac99fcbb1482a605737bf2ddb864abf2a1f20ef77bd0d5301b4bfd1bba" exitCode=0 Jun 05 18:00:35.237972 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:35.237600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" event={"ID":"a976ac9f-d074-4712-ac0e-dd904bf072af","Type":"ContainerDied","Data":"279bf6ac99fcbb1482a605737bf2ddb864abf2a1f20ef77bd0d5301b4bfd1bba"} Jun 05 18:00:36.373183 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.373159 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:36.557796 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.557704 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-util\") pod \"a976ac9f-d074-4712-ac0e-dd904bf072af\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " Jun 05 18:00:36.557796 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.557752 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-bundle\") pod \"a976ac9f-d074-4712-ac0e-dd904bf072af\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " Jun 05 18:00:36.557796 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.557786 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzvlz\" (UniqueName: \"kubernetes.io/projected/a976ac9f-d074-4712-ac0e-dd904bf072af-kube-api-access-bzvlz\") pod \"a976ac9f-d074-4712-ac0e-dd904bf072af\" (UID: \"a976ac9f-d074-4712-ac0e-dd904bf072af\") " Jun 05 18:00:36.558328 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.558293 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-bundle" (OuterVolumeSpecName: "bundle") pod "a976ac9f-d074-4712-ac0e-dd904bf072af" (UID: "a976ac9f-d074-4712-ac0e-dd904bf072af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:00:36.560164 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.560139 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a976ac9f-d074-4712-ac0e-dd904bf072af-kube-api-access-bzvlz" (OuterVolumeSpecName: "kube-api-access-bzvlz") pod "a976ac9f-d074-4712-ac0e-dd904bf072af" (UID: "a976ac9f-d074-4712-ac0e-dd904bf072af"). InnerVolumeSpecName "kube-api-access-bzvlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:00:36.563386 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.563365 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-util" (OuterVolumeSpecName: "util") pod "a976ac9f-d074-4712-ac0e-dd904bf072af" (UID: "a976ac9f-d074-4712-ac0e-dd904bf072af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:00:36.658693 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.658648 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzvlz\" (UniqueName: \"kubernetes.io/projected/a976ac9f-d074-4712-ac0e-dd904bf072af-kube-api-access-bzvlz\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:00:36.658693 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.658691 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-util\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:00:36.658693 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:36.658703 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a976ac9f-d074-4712-ac0e-dd904bf072af-bundle\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:00:37.248558 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:37.248530 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" Jun 05 18:00:37.248558 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:37.248542 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d9jxc" event={"ID":"a976ac9f-d074-4712-ac0e-dd904bf072af","Type":"ContainerDied","Data":"90dfa96c2ec7e787138de2e59ce4b38f382479c33ce9e7f57b8b0b65100a5c77"} Jun 05 18:00:37.248783 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:37.248583 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90dfa96c2ec7e787138de2e59ce4b38f382479c33ce9e7f57b8b0b65100a5c77" Jun 05 18:00:40.276617 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.276583 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-gsdkj"] Jun 05 18:00:40.276998 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.276961 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="pull" Jun 05 18:00:40.276998 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.276974 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="pull" Jun 05 18:00:40.276998 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.276989 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="extract" Jun 05 18:00:40.276998 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.276995 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="extract" Jun 05 18:00:40.277120 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.277004 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="util" Jun 05 18:00:40.277120 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.277009 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="util" Jun 05 18:00:40.277120 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.277056 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a976ac9f-d074-4712-ac0e-dd904bf072af" containerName="extract" Jun 05 18:00:40.278842 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.278827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" Jun 05 18:00:40.281348 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.281320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-mlprg\"" Jun 05 18:00:40.282309 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.282289 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 18:00:40.282638 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.282606 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 18:00:40.283223 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.283203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzts\" (UniqueName: \"kubernetes.io/projected/81dc987e-e7a9-4e58-b0ce-5481c67e7447-kube-api-access-8nzts\") pod \"keycloak-operator-dd84cbf46-gsdkj\" (UID: \"81dc987e-e7a9-4e58-b0ce-5481c67e7447\") " pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" Jun 05 18:00:40.290076 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.290054 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-gsdkj"] Jun 05 18:00:40.383858 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.383817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzts\" (UniqueName: \"kubernetes.io/projected/81dc987e-e7a9-4e58-b0ce-5481c67e7447-kube-api-access-8nzts\") pod \"keycloak-operator-dd84cbf46-gsdkj\" (UID: \"81dc987e-e7a9-4e58-b0ce-5481c67e7447\") " pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" Jun 05 18:00:40.393069 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.393046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzts\" (UniqueName: \"kubernetes.io/projected/81dc987e-e7a9-4e58-b0ce-5481c67e7447-kube-api-access-8nzts\") pod \"keycloak-operator-dd84cbf46-gsdkj\" (UID: \"81dc987e-e7a9-4e58-b0ce-5481c67e7447\") " pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" Jun 05 18:00:40.588446 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.588366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" Jun 05 18:00:40.717023 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:40.716996 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-gsdkj"] Jun 05 18:00:40.719161 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:00:40.719121 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dc987e_e7a9_4e58_b0ce_5481c67e7447.slice/crio-c1071c0b27cc3a10ab29057b608c804d358b8592c74be5cb9781df9b65be6898 WatchSource:0}: Error finding container c1071c0b27cc3a10ab29057b608c804d358b8592c74be5cb9781df9b65be6898: Status 404 returned error can't find the container with id c1071c0b27cc3a10ab29057b608c804d358b8592c74be5cb9781df9b65be6898 Jun 05 18:00:41.270204 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:41.270165 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" event={"ID":"81dc987e-e7a9-4e58-b0ce-5481c67e7447","Type":"ContainerStarted","Data":"c1071c0b27cc3a10ab29057b608c804d358b8592c74be5cb9781df9b65be6898"} Jun 05 18:00:47.305401 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:47.305362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" event={"ID":"81dc987e-e7a9-4e58-b0ce-5481c67e7447","Type":"ContainerStarted","Data":"a678e42116a22d25d04102002ef8ccb163b6ca9c38ee4947d3b40ee5b706c88b"} Jun 05 18:00:47.323314 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:00:47.323256 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-gsdkj" podStartSLOduration=1.43956866 podStartE2EDuration="7.323242432s" totalImagesPullingTime="5.883673772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:00:47.32046885 +0000 UTC m=+709.349203781" watchObservedRunningTime="2026-06-05 18:00:47.323242432 +0000 UTC m=+709.351977351" Jun 05 18:01:26.254364 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.254328 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dj8tc"] Jun 05 18:01:26.261280 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.261261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:26.263851 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.263824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6cks\"" Jun 05 18:01:26.265383 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.265360 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dj8tc"] Jun 05 18:01:26.290179 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.290153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq4ct\" (UniqueName: \"kubernetes.io/projected/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1-kube-api-access-zq4ct\") pod \"authorino-5d4b67c446-dj8tc\" (UID: \"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1\") " pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:26.390574 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.390541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq4ct\" (UniqueName: \"kubernetes.io/projected/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1-kube-api-access-zq4ct\") pod \"authorino-5d4b67c446-dj8tc\" (UID: \"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1\") " pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:26.399473 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.399442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq4ct\" (UniqueName: \"kubernetes.io/projected/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1-kube-api-access-zq4ct\") pod \"authorino-5d4b67c446-dj8tc\" (UID: \"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1\") " pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:26.472802 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.472771 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dj8tc"] Jun 05 18:01:26.473073 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.473056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:26.499443 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.499411 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b9b44456b-n8r9z"] Jun 05 18:01:26.501936 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.501915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:26.511169 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.511139 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b9b44456b-n8r9z"] Jun 05 18:01:26.592336 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.592305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbfjx\" (UniqueName: \"kubernetes.io/projected/3efc78ab-1f8a-4852-b082-afca81bcbcb3-kube-api-access-cbfjx\") pod \"authorino-5b9b44456b-n8r9z\" (UID: \"3efc78ab-1f8a-4852-b082-afca81bcbcb3\") " pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:26.610033 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.610006 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dj8tc"] Jun 05 18:01:26.611491 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:01:26.611464 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ad83996_74f7_4664_a0e7_9f0a46e2e2d1.slice/crio-490691f6d3bd37fdc4da96000b9d04336db3073198ab7027fe605365df0173b8 WatchSource:0}: Error finding container 490691f6d3bd37fdc4da96000b9d04336db3073198ab7027fe605365df0173b8: Status 404 returned error can't find the container with id 490691f6d3bd37fdc4da96000b9d04336db3073198ab7027fe605365df0173b8 Jun 05 18:01:26.612923 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.612902 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 18:01:26.692995 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.692956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbfjx\" (UniqueName: \"kubernetes.io/projected/3efc78ab-1f8a-4852-b082-afca81bcbcb3-kube-api-access-cbfjx\") pod \"authorino-5b9b44456b-n8r9z\" (UID: \"3efc78ab-1f8a-4852-b082-afca81bcbcb3\") " pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:26.703106 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.703076 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbfjx\" (UniqueName: \"kubernetes.io/projected/3efc78ab-1f8a-4852-b082-afca81bcbcb3-kube-api-access-cbfjx\") pod \"authorino-5b9b44456b-n8r9z\" (UID: \"3efc78ab-1f8a-4852-b082-afca81bcbcb3\") " pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:26.731342 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.731314 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b9b44456b-n8r9z"] Jun 05 18:01:26.731569 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.731557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:26.759089 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.759064 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f5599b9c4-nn4wr"] Jun 05 18:01:26.761814 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.761752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:26.764294 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.764271 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 18:01:26.769576 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.769551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5599b9c4-nn4wr"] Jun 05 18:01:26.794224 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.794193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3898f58-36a2-4c5a-a163-fa1810a3e782-tls-cert\") pod \"authorino-7f5599b9c4-nn4wr\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:26.794346 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.794299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69px9\" (UniqueName: \"kubernetes.io/projected/e3898f58-36a2-4c5a-a163-fa1810a3e782-kube-api-access-69px9\") pod \"authorino-7f5599b9c4-nn4wr\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:26.865798 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.865716 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b9b44456b-n8r9z"] Jun 05 18:01:26.868009 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:01:26.867967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3efc78ab_1f8a_4852_b082_afca81bcbcb3.slice/crio-930e8e6e901d7748382a23eaf4867b8121709d57b49a63bbe3de98b6776be678 WatchSource:0}: Error finding container 930e8e6e901d7748382a23eaf4867b8121709d57b49a63bbe3de98b6776be678: Status 404 returned error can't find the container with id 930e8e6e901d7748382a23eaf4867b8121709d57b49a63bbe3de98b6776be678 Jun 05 18:01:26.895195 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.895154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3898f58-36a2-4c5a-a163-fa1810a3e782-tls-cert\") pod \"authorino-7f5599b9c4-nn4wr\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:26.895360 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.895237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69px9\" (UniqueName: \"kubernetes.io/projected/e3898f58-36a2-4c5a-a163-fa1810a3e782-kube-api-access-69px9\") pod \"authorino-7f5599b9c4-nn4wr\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:26.897491 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.897472 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3898f58-36a2-4c5a-a163-fa1810a3e782-tls-cert\") pod \"authorino-7f5599b9c4-nn4wr\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:26.904009 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:26.903990 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69px9\" (UniqueName: \"kubernetes.io/projected/e3898f58-36a2-4c5a-a163-fa1810a3e782-kube-api-access-69px9\") pod \"authorino-7f5599b9c4-nn4wr\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:27.074495 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.074382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:01:27.206151 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.206127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5599b9c4-nn4wr"] Jun 05 18:01:27.208047 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:01:27.208020 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3898f58_36a2_4c5a_a163_fa1810a3e782.slice/crio-e39e2a3aaffa8bc04320cc8d3620234ca12f5af3a79c7adef965158bd998d0bc WatchSource:0}: Error finding container e39e2a3aaffa8bc04320cc8d3620234ca12f5af3a79c7adef965158bd998d0bc: Status 404 returned error can't find the container with id e39e2a3aaffa8bc04320cc8d3620234ca12f5af3a79c7adef965158bd998d0bc Jun 05 18:01:27.521609 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.521578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" event={"ID":"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1","Type":"ContainerStarted","Data":"de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb"} Jun 05 18:01:27.521609 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.521597 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" podUID="4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" containerName="authorino" containerID="cri-o://de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb" gracePeriod=30 Jun 05 18:01:27.522053 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.521642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" event={"ID":"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1","Type":"ContainerStarted","Data":"490691f6d3bd37fdc4da96000b9d04336db3073198ab7027fe605365df0173b8"} Jun 05 18:01:27.523334 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.523308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" event={"ID":"3efc78ab-1f8a-4852-b082-afca81bcbcb3","Type":"ContainerStarted","Data":"f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635"} Jun 05 18:01:27.523473 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.523345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" event={"ID":"3efc78ab-1f8a-4852-b082-afca81bcbcb3","Type":"ContainerStarted","Data":"930e8e6e901d7748382a23eaf4867b8121709d57b49a63bbe3de98b6776be678"} Jun 05 18:01:27.523473 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.523353 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" podUID="3efc78ab-1f8a-4852-b082-afca81bcbcb3" containerName="authorino" containerID="cri-o://f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635" gracePeriod=30 Jun 05 18:01:27.525250 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.525221 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" event={"ID":"e3898f58-36a2-4c5a-a163-fa1810a3e782","Type":"ContainerStarted","Data":"e39e2a3aaffa8bc04320cc8d3620234ca12f5af3a79c7adef965158bd998d0bc"} Jun 05 18:01:27.537928 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.537883 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" podStartSLOduration=1.193667787 podStartE2EDuration="1.537865826s" totalImagesPullingTime="344.198039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:01:27.536713374 +0000 UTC m=+749.565448295" watchObservedRunningTime="2026-06-05 18:01:27.537865826 +0000 UTC m=+749.566600745" Jun 05 18:01:27.554981 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.554927 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" podStartSLOduration=1.207962386 podStartE2EDuration="1.554910142s" totalImagesPullingTime="346.947756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:01:27.553778487 +0000 UTC m=+749.582513406" watchObservedRunningTime="2026-06-05 18:01:27.554910142 +0000 UTC m=+749.583645103" Jun 05 18:01:27.791865 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.791833 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:27.795286 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.795261 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:27.802502 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.802473 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbfjx\" (UniqueName: \"kubernetes.io/projected/3efc78ab-1f8a-4852-b082-afca81bcbcb3-kube-api-access-cbfjx\") pod \"3efc78ab-1f8a-4852-b082-afca81bcbcb3\" (UID: \"3efc78ab-1f8a-4852-b082-afca81bcbcb3\") " Jun 05 18:01:27.802685 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.802517 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq4ct\" (UniqueName: \"kubernetes.io/projected/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1-kube-api-access-zq4ct\") pod \"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1\" (UID: \"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1\") " Jun 05 18:01:27.804686 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.804661 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1-kube-api-access-zq4ct" (OuterVolumeSpecName: "kube-api-access-zq4ct") pod "4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" (UID: "4ad83996-74f7-4664-a0e7-9f0a46e2e2d1"). InnerVolumeSpecName "kube-api-access-zq4ct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:01:27.804794 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.804722 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efc78ab-1f8a-4852-b082-afca81bcbcb3-kube-api-access-cbfjx" (OuterVolumeSpecName: "kube-api-access-cbfjx") pod "3efc78ab-1f8a-4852-b082-afca81bcbcb3" (UID: "3efc78ab-1f8a-4852-b082-afca81bcbcb3"). InnerVolumeSpecName "kube-api-access-cbfjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:01:27.903472 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.903428 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbfjx\" (UniqueName: \"kubernetes.io/projected/3efc78ab-1f8a-4852-b082-afca81bcbcb3-kube-api-access-cbfjx\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:01:27.903472 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:27.903465 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq4ct\" (UniqueName: \"kubernetes.io/projected/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1-kube-api-access-zq4ct\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:01:28.532340 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.532304 2579 generic.go:356] "Generic (PLEG): container finished" podID="3efc78ab-1f8a-4852-b082-afca81bcbcb3" containerID="f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635" exitCode=0 Jun 05 18:01:28.532822 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.532354 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" Jun 05 18:01:28.532822 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.532388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" event={"ID":"3efc78ab-1f8a-4852-b082-afca81bcbcb3","Type":"ContainerDied","Data":"f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635"} Jun 05 18:01:28.532822 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.532430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9b44456b-n8r9z" event={"ID":"3efc78ab-1f8a-4852-b082-afca81bcbcb3","Type":"ContainerDied","Data":"930e8e6e901d7748382a23eaf4867b8121709d57b49a63bbe3de98b6776be678"} Jun 05 18:01:28.532822 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.532449 2579 scope.go:117] "RemoveContainer" containerID="f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635" Jun 05 18:01:28.534227 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.534186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" event={"ID":"e3898f58-36a2-4c5a-a163-fa1810a3e782","Type":"ContainerStarted","Data":"f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a"} Jun 05 18:01:28.535719 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.535697 2579 generic.go:356] "Generic (PLEG): container finished" podID="4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" containerID="de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb" exitCode=0 Jun 05 18:01:28.535826 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.535739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" event={"ID":"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1","Type":"ContainerDied","Data":"de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb"} Jun 05 18:01:28.535826 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.535761 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" Jun 05 18:01:28.535826 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.535769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dj8tc" event={"ID":"4ad83996-74f7-4664-a0e7-9f0a46e2e2d1","Type":"ContainerDied","Data":"490691f6d3bd37fdc4da96000b9d04336db3073198ab7027fe605365df0173b8"} Jun 05 18:01:28.542064 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.542041 2579 scope.go:117] "RemoveContainer" containerID="f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635" Jun 05 18:01:28.542328 ip-10-0-128-168 kubenswrapper[2579]: E0605 18:01:28.542304 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635\": container with ID starting with f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635 not found: ID does not exist" containerID="f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635" Jun 05 18:01:28.542404 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.542335 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635"} err="failed to get container status \"f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635\": rpc error: code = NotFound desc = could not find container \"f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635\": container with ID starting with f808a2039286a92fc373b45c1e07b67d635e0f8a0e56f7a893a7256078aec635 not found: ID does not exist" Jun 05 18:01:28.542404 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.542352 2579 scope.go:117] "RemoveContainer" containerID="de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb" Jun 05 18:01:28.549926 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.549908 2579 scope.go:117] "RemoveContainer" containerID="de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb" Jun 05 18:01:28.550191 ip-10-0-128-168 kubenswrapper[2579]: E0605 18:01:28.550174 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb\": container with ID starting with de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb not found: ID does not exist" containerID="de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb" Jun 05 18:01:28.550237 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.550200 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb"} err="failed to get container status \"de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb\": rpc error: code = NotFound desc = could not find container \"de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb\": container with ID starting with de6d0c67d4f6e9ce7903e1280f1cde57b628efab6a649bd358cfe30abf73e8cb not found: ID does not exist" Jun 05 18:01:28.556510 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.556470 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" podStartSLOduration=2.244849118 podStartE2EDuration="2.556456596s" totalImagesPullingTime="311.607478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:01:28.554005502 +0000 UTC m=+750.582740424" watchObservedRunningTime="2026-06-05 18:01:28.556456596 +0000 UTC m=+750.585191516" Jun 05 18:01:28.570231 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.570206 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b9b44456b-n8r9z"] Jun 05 18:01:28.581523 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.577949 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b9b44456b-n8r9z"] Jun 05 18:01:28.593709 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.593686 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dj8tc"] Jun 05 18:01:28.600943 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:28.600874 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dj8tc"] Jun 05 18:01:30.426595 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:30.426560 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efc78ab-1f8a-4852-b082-afca81bcbcb3" path="/var/lib/kubelet/pods/3efc78ab-1f8a-4852-b082-afca81bcbcb3/volumes" Jun 05 18:01:30.427227 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:01:30.427103 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" path="/var/lib/kubelet/pods/4ad83996-74f7-4664-a0e7-9f0a46e2e2d1/volumes" Jun 05 18:02:14.648435 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.647209 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nkhlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:56690->10.133.0.32:15021: read: connection reset by peer" start-of-body= Jun 05 18:02:14.648435 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.647287 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" podUID="ba18d7ea-dcbe-465c-b1d7-804677a19df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:56690->10.133.0.32:15021: read: connection reset by peer" Jun 05 18:02:14.780458 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.780424 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba18d7ea-dcbe-465c-b1d7-804677a19df9" containerID="f941ff2363dec8d3ec1b9f42479ca9e5977c6879500a5f831f5f702f5b40462a" exitCode=0 Jun 05 18:02:14.780646 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.780503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" event={"ID":"ba18d7ea-dcbe-465c-b1d7-804677a19df9","Type":"ContainerDied","Data":"f941ff2363dec8d3ec1b9f42479ca9e5977c6879500a5f831f5f702f5b40462a"} Jun 05 18:02:14.780963 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.780949 2579 scope.go:117] "RemoveContainer" containerID="f941ff2363dec8d3ec1b9f42479ca9e5977c6879500a5f831f5f702f5b40462a" Jun 05 18:02:14.782013 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.781986 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:02:14.782075 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.782056 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:02:14.782110 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:14.782095 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:02:15.787359 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:15.787327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" event={"ID":"ba18d7ea-dcbe-465c-b1d7-804677a19df9","Type":"ContainerStarted","Data":"64b71c2312b0b876dcb3e5cb3877185655089e9d66c2c784108e89fd18cf26ea"} Jun 05 18:02:15.929734 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:15.929695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 18:02:15.930115 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:15.930090 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nkhlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 05 18:02:15.930264 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:15.930241 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" podUID="ba18d7ea-dcbe-465c-b1d7-804677a19df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 05 18:02:16.930051 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:16.929561 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nkhlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 05 18:02:16.930051 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:16.929656 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" podUID="ba18d7ea-dcbe-465c-b1d7-804677a19df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 05 18:02:17.929852 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:17.929809 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nkhlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 05 18:02:17.930173 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:17.930139 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" podUID="ba18d7ea-dcbe-465c-b1d7-804677a19df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 05 18:02:18.929117 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:18.929077 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nkhlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 05 18:02:18.929430 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:18.929396 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" podUID="ba18d7ea-dcbe-465c-b1d7-804677a19df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 05 18:02:19.933323 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:19.933293 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 18:02:19.934942 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:19.934914 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 18:02:19.940344 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:02:19.940313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nkhlt" Jun 05 18:03:08.619658 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.619611 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f5599b9c4-nn4wr"] Jun 05 18:03:08.620166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.619834 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" podUID="e3898f58-36a2-4c5a-a163-fa1810a3e782" containerName="authorino" containerID="cri-o://f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a" gracePeriod=30 Jun 05 18:03:08.869280 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.869255 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:03:08.910722 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.910612 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69px9\" (UniqueName: \"kubernetes.io/projected/e3898f58-36a2-4c5a-a163-fa1810a3e782-kube-api-access-69px9\") pod \"e3898f58-36a2-4c5a-a163-fa1810a3e782\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " Jun 05 18:03:08.910722 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.910694 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3898f58-36a2-4c5a-a163-fa1810a3e782-tls-cert\") pod \"e3898f58-36a2-4c5a-a163-fa1810a3e782\" (UID: \"e3898f58-36a2-4c5a-a163-fa1810a3e782\") " Jun 05 18:03:08.912868 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.912829 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3898f58-36a2-4c5a-a163-fa1810a3e782-kube-api-access-69px9" (OuterVolumeSpecName: "kube-api-access-69px9") pod "e3898f58-36a2-4c5a-a163-fa1810a3e782" (UID: "e3898f58-36a2-4c5a-a163-fa1810a3e782"). InnerVolumeSpecName "kube-api-access-69px9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:03:08.920220 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:08.920198 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3898f58-36a2-4c5a-a163-fa1810a3e782-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e3898f58-36a2-4c5a-a163-fa1810a3e782" (UID: "e3898f58-36a2-4c5a-a163-fa1810a3e782"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 18:03:09.012259 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.012230 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69px9\" (UniqueName: \"kubernetes.io/projected/e3898f58-36a2-4c5a-a163-fa1810a3e782-kube-api-access-69px9\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:03:09.012259 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.012255 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3898f58-36a2-4c5a-a163-fa1810a3e782-tls-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:03:09.058962 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.058929 2579 generic.go:356] "Generic (PLEG): container finished" podID="e3898f58-36a2-4c5a-a163-fa1810a3e782" containerID="f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a" exitCode=0 Jun 05 18:03:09.059166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.058975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" event={"ID":"e3898f58-36a2-4c5a-a163-fa1810a3e782","Type":"ContainerDied","Data":"f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a"} Jun 05 18:03:09.059166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.058982 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" Jun 05 18:03:09.059166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.059002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5599b9c4-nn4wr" event={"ID":"e3898f58-36a2-4c5a-a163-fa1810a3e782","Type":"ContainerDied","Data":"e39e2a3aaffa8bc04320cc8d3620234ca12f5af3a79c7adef965158bd998d0bc"} Jun 05 18:03:09.059166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.059018 2579 scope.go:117] "RemoveContainer" containerID="f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a" Jun 05 18:03:09.067759 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.067742 2579 scope.go:117] "RemoveContainer" containerID="f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a" Jun 05 18:03:09.068016 ip-10-0-128-168 kubenswrapper[2579]: E0605 18:03:09.067998 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a\": container with ID starting with f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a not found: ID does not exist" containerID="f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a" Jun 05 18:03:09.068066 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.068024 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a"} err="failed to get container status \"f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a\": rpc error: code = NotFound desc = could not find container \"f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a\": container with ID starting with f9aa6d3931fa644e61279f1a055260fe298c887db1dc9254832c28d0391d709a not found: ID does not exist" Jun 05 18:03:09.080448 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.080422 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f5599b9c4-nn4wr"] Jun 05 18:03:09.091361 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:09.089034 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f5599b9c4-nn4wr"] Jun 05 18:03:10.426270 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:10.426236 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3898f58-36a2-4c5a-a163-fa1810a3e782" path="/var/lib/kubelet/pods/e3898f58-36a2-4c5a-a163-fa1810a3e782/volumes" Jun 05 18:03:57.477282 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477244 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl"] Jun 05 18:03:57.477702 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477606 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" containerName="authorino" Jun 05 18:03:57.477702 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477617 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" containerName="authorino" Jun 05 18:03:57.477702 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477651 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3898f58-36a2-4c5a-a163-fa1810a3e782" containerName="authorino" Jun 05 18:03:57.477702 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477657 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3898f58-36a2-4c5a-a163-fa1810a3e782" containerName="authorino" Jun 05 18:03:57.477702 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477667 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efc78ab-1f8a-4852-b082-afca81bcbcb3" containerName="authorino" Jun 05 18:03:57.477702 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477673 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efc78ab-1f8a-4852-b082-afca81bcbcb3" containerName="authorino" Jun 05 18:03:57.477893 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477724 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3898f58-36a2-4c5a-a163-fa1810a3e782" containerName="authorino" Jun 05 18:03:57.477893 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477734 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efc78ab-1f8a-4852-b082-afca81bcbcb3" containerName="authorino" Jun 05 18:03:57.477893 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.477742 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad83996-74f7-4664-a0e7-9f0a46e2e2d1" containerName="authorino" Jun 05 18:03:57.480032 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.480015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.483983 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.483959 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 18:03:57.485210 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.485192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zmfcl\"" Jun 05 18:03:57.485312 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.485192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 18:03:57.485312 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.485191 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 18:03:57.495689 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.495666 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl"] Jun 05 18:03:57.541221 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.541190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.541388 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.541247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.541388 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.541310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7kz\" (UniqueName: \"kubernetes.io/projected/479aa8b3-85c3-48fe-97bd-c26cdde33784-kube-api-access-xv7kz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.541388 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.541359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.541388 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.541381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.541572 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.541403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/479aa8b3-85c3-48fe-97bd-c26cdde33784-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642378 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642336 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642557 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642557 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7kz\" (UniqueName: \"kubernetes.io/projected/479aa8b3-85c3-48fe-97bd-c26cdde33784-kube-api-access-xv7kz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642557 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642714 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642714 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/479aa8b3-85c3-48fe-97bd-c26cdde33784-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642848 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.642930 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.643023 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.642969 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.644762 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.644744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/479aa8b3-85c3-48fe-97bd-c26cdde33784-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.645132 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.645111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/479aa8b3-85c3-48fe-97bd-c26cdde33784-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.650884 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.650853 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7kz\" (UniqueName: \"kubernetes.io/projected/479aa8b3-85c3-48fe-97bd-c26cdde33784-kube-api-access-xv7kz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl\" (UID: \"479aa8b3-85c3-48fe-97bd-c26cdde33784\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.790473 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.790375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:03:57.923748 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:57.923724 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl"] Jun 05 18:03:57.925880 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:03:57.925855 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479aa8b3_85c3_48fe_97bd_c26cdde33784.slice/crio-930323170add564c01e933a98d7a587d8d06efbc8b9de18e3a96f6b3dfd8b4a3 WatchSource:0}: Error finding container 930323170add564c01e933a98d7a587d8d06efbc8b9de18e3a96f6b3dfd8b4a3: Status 404 returned error can't find the container with id 930323170add564c01e933a98d7a587d8d06efbc8b9de18e3a96f6b3dfd8b4a3 Jun 05 18:03:58.309531 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:03:58.309495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" event={"ID":"479aa8b3-85c3-48fe-97bd-c26cdde33784","Type":"ContainerStarted","Data":"930323170add564c01e933a98d7a587d8d06efbc8b9de18e3a96f6b3dfd8b4a3"} Jun 05 18:04:02.335949 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:02.335910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" event={"ID":"479aa8b3-85c3-48fe-97bd-c26cdde33784","Type":"ContainerStarted","Data":"006dbe58e60ebee7aa7d5a82ca4597a617ef05f4aebe1de3c4549e1c2d5ec53f"} Jun 05 18:04:03.342868 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:03.342771 2579 generic.go:356] "Generic (PLEG): container finished" podID="479aa8b3-85c3-48fe-97bd-c26cdde33784" containerID="006dbe58e60ebee7aa7d5a82ca4597a617ef05f4aebe1de3c4549e1c2d5ec53f" exitCode=0 Jun 05 18:04:03.343408 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:03.342865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" event={"ID":"479aa8b3-85c3-48fe-97bd-c26cdde33784","Type":"ContainerDied","Data":"006dbe58e60ebee7aa7d5a82ca4597a617ef05f4aebe1de3c4549e1c2d5ec53f"} Jun 05 18:04:05.355577 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:05.355539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" event={"ID":"479aa8b3-85c3-48fe-97bd-c26cdde33784","Type":"ContainerStarted","Data":"b0b5bea94ed4f2d45c797abb1c70e14b081c771eac7977b7f628b4f97e6a5ea2"} Jun 05 18:04:05.378265 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:05.378212 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" podStartSLOduration=2.302761331 podStartE2EDuration="8.37819665s" totalImagesPullingTime="4.650686295s" totalInitContainerRuntime="1.424749024s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:03:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:04:05.376305232 +0000 UTC m=+907.405040146" watchObservedRunningTime="2026-06-05 18:04:05.37819665 +0000 UTC m=+907.406931570" Jun 05 18:04:07.790773 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:07.790722 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:04:07.791188 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:07.790808 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:04:07.803359 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:07.803330 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:04:08.381675 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:04:08.381644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl" Jun 05 18:05:54.549108 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:05:54.549069 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-bfrz4" podUID="7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 18:05:54.549523 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:05:54.549201 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 18:05:54.549945 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:05:54.549918 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-bfrz4" podUID="7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 18:06:24.550707 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:06:24.550671 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bfrz4" Jun 05 18:15:00.188509 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.188467 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29678055-zv6xj"] Jun 05 18:15:00.191904 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.191882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:00.196133 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.196110 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-h86lk\"" Jun 05 18:15:00.228818 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.228793 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29678055-zv6xj"] Jun 05 18:15:00.310826 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.310777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2zw\" (UniqueName: \"kubernetes.io/projected/173c5e51-c211-49ef-a9bc-21f8c0381632-kube-api-access-jm2zw\") pod \"maas-api-key-cleanup-29678055-zv6xj\" (UID: \"173c5e51-c211-49ef-a9bc-21f8c0381632\") " pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:00.412211 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.412157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2zw\" (UniqueName: \"kubernetes.io/projected/173c5e51-c211-49ef-a9bc-21f8c0381632-kube-api-access-jm2zw\") pod \"maas-api-key-cleanup-29678055-zv6xj\" (UID: \"173c5e51-c211-49ef-a9bc-21f8c0381632\") " pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:00.422301 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.422270 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2zw\" (UniqueName: \"kubernetes.io/projected/173c5e51-c211-49ef-a9bc-21f8c0381632-kube-api-access-jm2zw\") pod \"maas-api-key-cleanup-29678055-zv6xj\" (UID: \"173c5e51-c211-49ef-a9bc-21f8c0381632\") " pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:00.502061 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.501968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:00.657766 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.657739 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29678055-zv6xj"] Jun 05 18:15:00.659293 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:15:00.659267 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173c5e51_c211_49ef_a9bc_21f8c0381632.slice/crio-00d31a1f3d3ccdb476b29aa6dd2ba26dee590c83cf3a7df7592b81fa49c446e6 WatchSource:0}: Error finding container 00d31a1f3d3ccdb476b29aa6dd2ba26dee590c83cf3a7df7592b81fa49c446e6: Status 404 returned error can't find the container with id 00d31a1f3d3ccdb476b29aa6dd2ba26dee590c83cf3a7df7592b81fa49c446e6 Jun 05 18:15:00.661263 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:00.661248 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 18:15:01.656296 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:01.656262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" event={"ID":"173c5e51-c211-49ef-a9bc-21f8c0381632","Type":"ContainerStarted","Data":"00d31a1f3d3ccdb476b29aa6dd2ba26dee590c83cf3a7df7592b81fa49c446e6"} Jun 05 18:15:03.669525 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:03.669485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" event={"ID":"173c5e51-c211-49ef-a9bc-21f8c0381632","Type":"ContainerStarted","Data":"47ac23dc2a7fae2f3fc630ca27725ea605c8b30de37cea7dcf6f1713f32b3bb6"} Jun 05 18:15:03.690551 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:03.690497 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" podStartSLOduration=1.120789883 podStartE2EDuration="3.6904807s" totalImagesPullingTime="2.569690817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:15:03.689601933 +0000 UTC m=+1565.718336853" watchObservedRunningTime="2026-06-05 18:15:03.6904807 +0000 UTC m=+1565.719215695" Jun 05 18:15:04.675842 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:04.675805 2579 generic.go:356] "Generic (PLEG): container finished" podID="173c5e51-c211-49ef-a9bc-21f8c0381632" containerID="47ac23dc2a7fae2f3fc630ca27725ea605c8b30de37cea7dcf6f1713f32b3bb6" exitCode=0 Jun 05 18:15:04.676226 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:04.675890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" event={"ID":"173c5e51-c211-49ef-a9bc-21f8c0381632","Type":"ContainerDied","Data":"47ac23dc2a7fae2f3fc630ca27725ea605c8b30de37cea7dcf6f1713f32b3bb6"} Jun 05 18:15:05.818844 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:05.818817 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:05.962770 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:05.962666 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm2zw\" (UniqueName: \"kubernetes.io/projected/173c5e51-c211-49ef-a9bc-21f8c0381632-kube-api-access-jm2zw\") pod \"173c5e51-c211-49ef-a9bc-21f8c0381632\" (UID: \"173c5e51-c211-49ef-a9bc-21f8c0381632\") " Jun 05 18:15:05.964938 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:05.964902 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173c5e51-c211-49ef-a9bc-21f8c0381632-kube-api-access-jm2zw" (OuterVolumeSpecName: "kube-api-access-jm2zw") pod "173c5e51-c211-49ef-a9bc-21f8c0381632" (UID: "173c5e51-c211-49ef-a9bc-21f8c0381632"). InnerVolumeSpecName "kube-api-access-jm2zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:15:06.063735 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:06.063701 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm2zw\" (UniqueName: \"kubernetes.io/projected/173c5e51-c211-49ef-a9bc-21f8c0381632-kube-api-access-jm2zw\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:15:06.688325 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:06.688242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" event={"ID":"173c5e51-c211-49ef-a9bc-21f8c0381632","Type":"ContainerDied","Data":"00d31a1f3d3ccdb476b29aa6dd2ba26dee590c83cf3a7df7592b81fa49c446e6"} Jun 05 18:15:06.688325 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:06.688263 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678055-zv6xj" Jun 05 18:15:06.688325 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:15:06.688294 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00d31a1f3d3ccdb476b29aa6dd2ba26dee590c83cf3a7df7592b81fa49c446e6" Jun 05 18:18:25.406200 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.406157 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t"] Jun 05 18:18:25.406841 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.406691 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173c5e51-c211-49ef-a9bc-21f8c0381632" containerName="cleanup" Jun 05 18:18:25.406841 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.406713 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="173c5e51-c211-49ef-a9bc-21f8c0381632" containerName="cleanup" Jun 05 18:18:25.406981 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.406865 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="173c5e51-c211-49ef-a9bc-21f8c0381632" containerName="cleanup" Jun 05 18:18:25.409947 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.409924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.413486 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.413466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v85fv\"" Jun 05 18:18:25.425468 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.425444 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t"] Jun 05 18:18:25.524135 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.524093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc779329-efc9-4099-ac65-a7e41afc49ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jp8t\" (UID: \"cc779329-efc9-4099-ac65-a7e41afc49ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.524335 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.524260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpbxq\" (UniqueName: \"kubernetes.io/projected/cc779329-efc9-4099-ac65-a7e41afc49ce-kube-api-access-tpbxq\") pod \"kuadrant-operator-controller-manager-86878c769f-5jp8t\" (UID: \"cc779329-efc9-4099-ac65-a7e41afc49ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.625794 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.625735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpbxq\" (UniqueName: \"kubernetes.io/projected/cc779329-efc9-4099-ac65-a7e41afc49ce-kube-api-access-tpbxq\") pod \"kuadrant-operator-controller-manager-86878c769f-5jp8t\" (UID: \"cc779329-efc9-4099-ac65-a7e41afc49ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.625794 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.625805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc779329-efc9-4099-ac65-a7e41afc49ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jp8t\" (UID: \"cc779329-efc9-4099-ac65-a7e41afc49ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.626202 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.626183 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc779329-efc9-4099-ac65-a7e41afc49ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5jp8t\" (UID: \"cc779329-efc9-4099-ac65-a7e41afc49ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.636419 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.636393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpbxq\" (UniqueName: \"kubernetes.io/projected/cc779329-efc9-4099-ac65-a7e41afc49ce-kube-api-access-tpbxq\") pod \"kuadrant-operator-controller-manager-86878c769f-5jp8t\" (UID: \"cc779329-efc9-4099-ac65-a7e41afc49ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.721242 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.721141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:25.868157 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:25.868131 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t"] Jun 05 18:18:25.870554 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:18:25.870529 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc779329_efc9_4099_ac65_a7e41afc49ce.slice/crio-9ad1f51d3303843e0d686e2e7101238f31dc13af87c546a6e2a14313e786f94d WatchSource:0}: Error finding container 9ad1f51d3303843e0d686e2e7101238f31dc13af87c546a6e2a14313e786f94d: Status 404 returned error can't find the container with id 9ad1f51d3303843e0d686e2e7101238f31dc13af87c546a6e2a14313e786f94d Jun 05 18:18:26.718192 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:26.718155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" event={"ID":"cc779329-efc9-4099-ac65-a7e41afc49ce","Type":"ContainerStarted","Data":"4f5c6eff1c0bdfa7d0b1eb655faddf22570eb8afd44f8b3929e5083cf40451f5"} Jun 05 18:18:26.718653 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:26.718210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" event={"ID":"cc779329-efc9-4099-ac65-a7e41afc49ce","Type":"ContainerStarted","Data":"9ad1f51d3303843e0d686e2e7101238f31dc13af87c546a6e2a14313e786f94d"} Jun 05 18:18:26.718653 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:26.718271 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:18:26.740550 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:26.740492 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" podStartSLOduration=1.740475668 podStartE2EDuration="1.740475668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:18:26.737126506 +0000 UTC m=+1768.765861417" watchObservedRunningTime="2026-06-05 18:18:26.740475668 +0000 UTC m=+1768.769210587" Jun 05 18:18:37.725576 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:18:37.725499 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5jp8t" Jun 05 18:27:55.144318 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.144277 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm"] Jun 05 18:27:55.147700 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.147676 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.157574 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.157547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8c0b23b4-openshift-default-dockercfg-prn62\"" Jun 05 18:27:55.207156 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.207119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm"] Jun 05 18:27:55.268049 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-token\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268249 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-credential-socket\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268249 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8pr7\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-kube-api-access-q8pr7\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268249 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-envoy\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268249 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-podinfo\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268877 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-socket\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268877 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-data\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268877 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-certs\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.268877 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.268366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7176df38-d377-4b44-8b3a-b6d77fcd875b-istiod-ca-cert\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369025 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.368988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8pr7\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-kube-api-access-q8pr7\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369025 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-envoy\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-podinfo\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-socket\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-data\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-certs\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7176df38-d377-4b44-8b3a-b6d77fcd875b-istiod-ca-cert\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-token\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369622 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-credential-socket\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369622 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-data\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369622 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369614 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-certs\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369813 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369701 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-socket\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369861 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-credential-socket\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.369925 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.369906 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7176df38-d377-4b44-8b3a-b6d77fcd875b-istiod-ca-cert\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.371928 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.371905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-envoy\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.372236 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.372216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-podinfo\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.379421 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.379401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-token\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.380213 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.380189 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8pr7\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-kube-api-access-q8pr7\") pod \"e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.458809 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.458727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:55.600166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.600140 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm"] Jun 05 18:27:55.602001 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:27:55.601974 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7176df38_d377_4b44_8b3a_b6d77fcd875b.slice/crio-d31e28d6d139a26b1cedeb6f5388898028c9be724d81c540ba15e5dc2e175256 WatchSource:0}: Error finding container d31e28d6d139a26b1cedeb6f5388898028c9be724d81c540ba15e5dc2e175256: Status 404 returned error can't find the container with id d31e28d6d139a26b1cedeb6f5388898028c9be724d81c540ba15e5dc2e175256 Jun 05 18:27:55.604045 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.604009 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:27:55.604130 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.604080 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:27:55.604130 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.604111 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:27:55.698070 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.698035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" event={"ID":"7176df38-d377-4b44-8b3a-b6d77fcd875b","Type":"ContainerStarted","Data":"2156143f25360be1cfd46fe4ae60396d8d072321e37814ec7af879d8cdc585ac"} Jun 05 18:27:55.698230 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.698093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" event={"ID":"7176df38-d377-4b44-8b3a-b6d77fcd875b","Type":"ContainerStarted","Data":"d31e28d6d139a26b1cedeb6f5388898028c9be724d81c540ba15e5dc2e175256"} Jun 05 18:27:55.723147 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:55.723036 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" podStartSLOduration=0.723014746 podStartE2EDuration="723.014746ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:27:55.720493602 +0000 UTC m=+2337.749228516" watchObservedRunningTime="2026-06-05 18:27:55.723014746 +0000 UTC m=+2337.751749666" Jun 05 18:27:56.459783 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:56.459728 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:56.464926 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:56.464901 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:56.703684 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:56.703655 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:27:56.704844 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:27:56.704824 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:28:01.569843 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:01.569802 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm"] Jun 05 18:28:01.570324 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:01.570002 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" podUID="7176df38-d377-4b44-8b3a-b6d77fcd875b" containerName="istio-proxy" containerID="cri-o://2156143f25360be1cfd46fe4ae60396d8d072321e37814ec7af879d8cdc585ac" gracePeriod=30 Jun 05 18:28:06.759642 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.759584 2579 generic.go:356] "Generic (PLEG): container finished" podID="7176df38-d377-4b44-8b3a-b6d77fcd875b" containerID="2156143f25360be1cfd46fe4ae60396d8d072321e37814ec7af879d8cdc585ac" exitCode=0 Jun 05 18:28:06.760046 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.759663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" event={"ID":"7176df38-d377-4b44-8b3a-b6d77fcd875b","Type":"ContainerDied","Data":"2156143f25360be1cfd46fe4ae60396d8d072321e37814ec7af879d8cdc585ac"} Jun 05 18:28:06.810927 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.810895 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:28:06.979737 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979707 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-token\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.979918 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979786 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-socket\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.979918 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979824 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-credential-socket\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.979918 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979845 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-envoy\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.979918 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979863 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-certs\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.979918 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979885 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7176df38-d377-4b44-8b3a-b6d77fcd875b-istiod-ca-cert\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.980187 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979940 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8pr7\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-kube-api-access-q8pr7\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.980187 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979967 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-podinfo\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.980187 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.979994 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-data\") pod \"7176df38-d377-4b44-8b3a-b6d77fcd875b\" (UID: \"7176df38-d377-4b44-8b3a-b6d77fcd875b\") " Jun 05 18:28:06.980187 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980133 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:06.980401 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980194 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:06.980401 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980175 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:06.980587 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980322 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-socket\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:06.980694 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980601 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-credential-socket\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:06.980694 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980401 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:06.980694 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.980315 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7176df38-d377-4b44-8b3a-b6d77fcd875b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 18:28:06.982162 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.982128 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:28:06.982162 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.982156 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 18:28:06.982334 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.982313 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:06.982446 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:06.982425 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-kube-api-access-q8pr7" (OuterVolumeSpecName: "kube-api-access-q8pr7") pod "7176df38-d377-4b44-8b3a-b6d77fcd875b" (UID: "7176df38-d377-4b44-8b3a-b6d77fcd875b"). InnerVolumeSpecName "kube-api-access-q8pr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:28:07.081399 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081360 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-envoy\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.081399 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081392 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-workload-certs\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.081399 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081402 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7176df38-d377-4b44-8b3a-b6d77fcd875b-istiod-ca-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.081399 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081410 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8pr7\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-kube-api-access-q8pr7\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.081710 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081421 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-podinfo\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.081710 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081430 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-data\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.081710 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.081439 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7176df38-d377-4b44-8b3a-b6d77fcd875b-istio-token\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:07.694673 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.694619 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb"] Jun 05 18:28:07.695101 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.695082 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7176df38-d377-4b44-8b3a-b6d77fcd875b" containerName="istio-proxy" Jun 05 18:28:07.695204 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.695102 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7176df38-d377-4b44-8b3a-b6d77fcd875b" containerName="istio-proxy" Jun 05 18:28:07.695264 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.695221 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7176df38-d377-4b44-8b3a-b6d77fcd875b" containerName="istio-proxy" Jun 05 18:28:07.698660 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.698620 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.701348 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.701327 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-002ffb0d-openshift-default-dockercfg-mg8gg\"" Jun 05 18:28:07.714760 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.714739 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb"] Jun 05 18:28:07.766964 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.766942 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" Jun 05 18:28:07.766964 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.766951 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm" event={"ID":"7176df38-d377-4b44-8b3a-b6d77fcd875b","Type":"ContainerDied","Data":"d31e28d6d139a26b1cedeb6f5388898028c9be724d81c540ba15e5dc2e175256"} Jun 05 18:28:07.767439 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.767013 2579 scope.go:117] "RemoveContainer" containerID="2156143f25360be1cfd46fe4ae60396d8d072321e37814ec7af879d8cdc585ac" Jun 05 18:28:07.787921 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.787894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9tc\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-kube-api-access-st9tc\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788035 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.787928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-socket\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788035 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.787949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-token\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788155 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.788043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-data\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788155 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.788117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-credential-socket\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788259 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.788187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-podinfo\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788259 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.788229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-envoy\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788367 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.788259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istiod-ca-cert\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.788367 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.788295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-certs\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.789297 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.789278 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm"] Jun 05 18:28:07.793712 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.793692 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8c0b23b4-openshift-default-758489d99d-64xqm"] Jun 05 18:28:07.889175 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-podinfo\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.889322 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-envoy\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.889322 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istiod-ca-cert\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.889494 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-certs\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.889554 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st9tc\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-kube-api-access-st9tc\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-socket\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-certs\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-token\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.889988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-data\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.890055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-credential-socket\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.890077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-socket\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890233 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.890181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istiod-ca-cert\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890552 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.890356 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-credential-socket\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.890552 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.890428 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-data\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.891695 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.891646 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-envoy\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.891878 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.891862 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-podinfo\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.899768 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.899742 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9tc\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-kube-api-access-st9tc\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:07.903818 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:07.903795 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-token\") pod \"e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:08.010938 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.010828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:08.155063 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.155038 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb"] Jun 05 18:28:08.156638 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:28:08.156606 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b40af0_a5d1_4349_8406_37a1b2cb9d7d.slice/crio-cf6f80c54ac8c1b479e736043bc496aa5ccf7065c9eb0000903d324de85977d3 WatchSource:0}: Error finding container cf6f80c54ac8c1b479e736043bc496aa5ccf7065c9eb0000903d324de85977d3: Status 404 returned error can't find the container with id cf6f80c54ac8c1b479e736043bc496aa5ccf7065c9eb0000903d324de85977d3 Jun 05 18:28:08.158820 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.158782 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:28:08.158922 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.158853 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:28:08.158922 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.158883 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 18:28:08.426980 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.426942 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7176df38-d377-4b44-8b3a-b6d77fcd875b" path="/var/lib/kubelet/pods/7176df38-d377-4b44-8b3a-b6d77fcd875b/volumes" Jun 05 18:28:08.773170 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.773069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" event={"ID":"92b40af0-a5d1-4349-8406-37a1b2cb9d7d","Type":"ContainerStarted","Data":"3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae"} Jun 05 18:28:08.773170 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.773126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" event={"ID":"92b40af0-a5d1-4349-8406-37a1b2cb9d7d","Type":"ContainerStarted","Data":"cf6f80c54ac8c1b479e736043bc496aa5ccf7065c9eb0000903d324de85977d3"} Jun 05 18:28:08.800445 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:08.800387 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" podStartSLOduration=1.8003713129999999 podStartE2EDuration="1.800371313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:28:08.798580627 +0000 UTC m=+2350.827315570" watchObservedRunningTime="2026-06-05 18:28:08.800371313 +0000 UTC m=+2350.829106287" Jun 05 18:28:09.011359 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:09.011330 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:09.015988 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:09.015963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:09.779637 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:09.779597 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:09.780593 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:09.780573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:15.099463 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:15.099428 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb"] Jun 05 18:28:15.099923 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:15.099611 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" podUID="92b40af0-a5d1-4349-8406-37a1b2cb9d7d" containerName="istio-proxy" containerID="cri-o://3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae" gracePeriod=30 Jun 05 18:28:20.357112 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.357085 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:20.393332 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.393250 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st9tc\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-kube-api-access-st9tc\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.393332 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.393289 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-token\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.393332 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.393313 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istiod-ca-cert\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.393719 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.393697 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 18:28:20.395465 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.395444 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-kube-api-access-st9tc" (OuterVolumeSpecName: "kube-api-access-st9tc") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "kube-api-access-st9tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:28:20.395575 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.395479 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:28:20.494578 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494542 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-envoy\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.494578 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494581 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-podinfo\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.494863 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494608 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-certs\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.494863 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494671 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-credential-socket\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.494863 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494720 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-socket\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.494863 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494744 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-data\") pod \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\" (UID: \"92b40af0-a5d1-4349-8406-37a1b2cb9d7d\") " Jun 05 18:28:20.495082 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494955 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:20.495082 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.494984 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:20.495082 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495001 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:20.495082 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495062 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:20.495218 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495184 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-socket\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.495218 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495206 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-data\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.495287 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495220 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st9tc\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-kube-api-access-st9tc\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.495287 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495236 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-token\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.495287 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495250 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istiod-ca-cert\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.495287 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495264 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-workload-certs\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.495287 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.495276 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-credential-socket\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.496686 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.496669 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:28:20.496750 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.496734 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92b40af0-a5d1-4349-8406-37a1b2cb9d7d" (UID: "92b40af0-a5d1-4349-8406-37a1b2cb9d7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 18:28:20.596304 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.596272 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-envoy\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.596304 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.596301 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92b40af0-a5d1-4349-8406-37a1b2cb9d7d-istio-podinfo\") on node \"ip-10-0-128-168.ec2.internal\" DevicePath \"\"" Jun 05 18:28:20.838026 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.837939 2579 generic.go:356] "Generic (PLEG): container finished" podID="92b40af0-a5d1-4349-8406-37a1b2cb9d7d" containerID="3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae" exitCode=0 Jun 05 18:28:20.838026 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.837987 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" Jun 05 18:28:20.838209 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.838027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" event={"ID":"92b40af0-a5d1-4349-8406-37a1b2cb9d7d","Type":"ContainerDied","Data":"3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae"} Jun 05 18:28:20.838209 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.838087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb" event={"ID":"92b40af0-a5d1-4349-8406-37a1b2cb9d7d","Type":"ContainerDied","Data":"cf6f80c54ac8c1b479e736043bc496aa5ccf7065c9eb0000903d324de85977d3"} Jun 05 18:28:20.838209 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.838110 2579 scope.go:117] "RemoveContainer" containerID="3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae" Jun 05 18:28:20.848213 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.848196 2579 scope.go:117] "RemoveContainer" containerID="3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae" Jun 05 18:28:20.848510 ip-10-0-128-168 kubenswrapper[2579]: E0605 18:28:20.848492 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae\": container with ID starting with 3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae not found: ID does not exist" containerID="3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae" Jun 05 18:28:20.848561 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.848521 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae"} err="failed to get container status \"3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae\": rpc error: code = NotFound desc = could not find container \"3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae\": container with ID starting with 3a63a7a3b214b0b347100b29c6e9bb0022c429043e9d6e171bbc9ccbc42823ae not found: ID does not exist" Jun 05 18:28:20.863782 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.863756 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb"] Jun 05 18:28:20.869139 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:20.869117 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-002ffb0d-openshift-default-54d445b57d-wnhtb"] Jun 05 18:28:22.426680 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:22.426646 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b40af0-a5d1-4349-8406-37a1b2cb9d7d" path="/var/lib/kubelet/pods/92b40af0-a5d1-4349-8406-37a1b2cb9d7d/volumes" Jun 05 18:28:32.971080 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:32.971053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dc4bb59b5-8mq9f_7613f619-0a15-4d81-a9f2-b63c74a15ec5/nginx/0.log" Jun 05 18:28:33.428195 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:33.428162 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29678055-zv6xj_173c5e51-c211-49ef-a9bc-21f8c0381632/cleanup/0.log" Jun 05 18:28:33.885492 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:33.885461 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp_5cf8ee0f-6508-4645-bafe-9ca485fbd1e4/copy-manifests/0.log" Jun 05 18:28:33.892140 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:33.892117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp_5cf8ee0f-6508-4645-bafe-9ca485fbd1e4/manager/0.log" Jun 05 18:28:34.239414 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:34.239336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-g54x6_70e684bc-8e25-4915-afcc-854d02c79869/postgres/0.log" Jun 05 18:28:34.971993 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:34.971959 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq_fb1a066d-4878-4523-b407-5fb537c517f6/pull/0.log" Jun 05 18:28:34.978817 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:34.978795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq_fb1a066d-4878-4523-b407-5fb537c517f6/extract/0.log" Jun 05 18:28:34.984949 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:34.984931 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq_fb1a066d-4878-4523-b407-5fb537c517f6/util/0.log" Jun 05 18:28:35.090563 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.090539 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l_98da461f-fb8a-4a16-a799-594bdf330586/util/0.log" Jun 05 18:28:35.096472 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.096446 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l_98da461f-fb8a-4a16-a799-594bdf330586/pull/0.log" Jun 05 18:28:35.103340 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.103315 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l_98da461f-fb8a-4a16-a799-594bdf330586/extract/0.log" Jun 05 18:28:35.213859 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.213830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v_641ba905-3e16-4d29-aade-ead2053e36e0/util/0.log" Jun 05 18:28:35.220088 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.220068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v_641ba905-3e16-4d29-aade-ead2053e36e0/pull/0.log" Jun 05 18:28:35.225998 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.225933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v_641ba905-3e16-4d29-aade-ead2053e36e0/extract/0.log" Jun 05 18:28:35.333941 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.333909 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx_3602c13d-e172-4ffe-9eb1-cf8917b643a7/util/0.log" Jun 05 18:28:35.341010 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.340980 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx_3602c13d-e172-4ffe-9eb1-cf8917b643a7/pull/0.log" Jun 05 18:28:35.347560 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.347534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx_3602c13d-e172-4ffe-9eb1-cf8917b643a7/extract/0.log" Jun 05 18:28:35.578012 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.577924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zfnj7_2f101a8d-d421-4f4d-aba6-46692bd563c3/manager/0.log" Jun 05 18:28:35.897418 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:35.897390 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jr45x_8118cf25-9d44-4208-920d-690b1896586a/registry-server/0.log" Jun 05 18:28:36.011556 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:36.011514 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5jp8t_cc779329-efc9-4099-ac65-a7e41afc49ce/manager/0.log" Jun 05 18:28:36.569160 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:36.569122 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795b82nc_80d00aa8-5fa6-4d15-bd8a-a7613fbb8909/istio-proxy/0.log" Jun 05 18:28:37.021421 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:37.021389 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/1.log" Jun 05 18:28:38.179004 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:38.178980 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl_479aa8b3-85c3-48fe-97bd-c26cdde33784/storage-initializer/0.log" Jun 05 18:28:38.186619 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:38.186594 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mzqtl_479aa8b3-85c3-48fe-97bd-c26cdde33784/main/0.log" Jun 05 18:28:45.006945 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:45.006900 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pm5kp_4ba16dce-991c-4df2-813e-cfb32a7c2434/global-pull-secret-syncer/0.log" Jun 05 18:28:45.122129 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:45.122099 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bfrz4_7a350cb0-e2ff-41f0-8fc5-0f6993a1e1c2/konnectivity-agent/0.log" Jun 05 18:28:45.173464 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:45.173416 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-168.ec2.internal_59cbe8b5e51f41f49bc87ba9b229c8d4/haproxy/0.log" Jun 05 18:28:49.762166 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.762136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq_fb1a066d-4878-4523-b407-5fb537c517f6/extract/0.log" Jun 05 18:28:49.794567 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.794539 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq_fb1a066d-4878-4523-b407-5fb537c517f6/util/0.log" Jun 05 18:28:49.822501 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.822479 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jgdsq_fb1a066d-4878-4523-b407-5fb537c517f6/pull/0.log" Jun 05 18:28:49.866124 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.866105 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l_98da461f-fb8a-4a16-a799-594bdf330586/extract/0.log" Jun 05 18:28:49.887804 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.887776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l_98da461f-fb8a-4a16-a799-594bdf330586/util/0.log" Jun 05 18:28:49.909947 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.909927 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09969l_98da461f-fb8a-4a16-a799-594bdf330586/pull/0.log" Jun 05 18:28:49.939171 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.939140 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v_641ba905-3e16-4d29-aade-ead2053e36e0/extract/0.log" Jun 05 18:28:49.965153 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.965124 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v_641ba905-3e16-4d29-aade-ead2053e36e0/util/0.log" Jun 05 18:28:49.990251 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:49.990230 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6t2v_641ba905-3e16-4d29-aade-ead2053e36e0/pull/0.log" Jun 05 18:28:50.031526 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:50.031448 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx_3602c13d-e172-4ffe-9eb1-cf8917b643a7/extract/0.log" Jun 05 18:28:50.056645 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:50.056605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx_3602c13d-e172-4ffe-9eb1-cf8917b643a7/util/0.log" Jun 05 18:28:50.085107 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:50.085085 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xxtx_3602c13d-e172-4ffe-9eb1-cf8917b643a7/pull/0.log" Jun 05 18:28:50.366985 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:50.366927 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zfnj7_2f101a8d-d421-4f4d-aba6-46692bd563c3/manager/0.log" Jun 05 18:28:50.477127 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:50.477085 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jr45x_8118cf25-9d44-4208-920d-690b1896586a/registry-server/0.log" Jun 05 18:28:50.533187 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:50.533151 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5jp8t_cc779329-efc9-4099-ac65-a7e41afc49ce/manager/0.log" Jun 05 18:28:52.126088 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.126027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/alertmanager/0.log" Jun 05 18:28:52.151453 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.151426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/config-reloader/0.log" Jun 05 18:28:52.175407 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.175384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/kube-rbac-proxy-web/0.log" Jun 05 18:28:52.199730 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.199709 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/kube-rbac-proxy/0.log" Jun 05 18:28:52.222517 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.222457 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/kube-rbac-proxy-metric/0.log" Jun 05 18:28:52.246444 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.246423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/prom-label-proxy/0.log" Jun 05 18:28:52.268995 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.268973 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_18e67694-9959-4dc9-8904-00335538a42b/init-config-reloader/0.log" Jun 05 18:28:52.432872 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.432771 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-9nt6q_95172d20-c3d7-400b-8fe4-0b47035d0217/monitoring-plugin/0.log" Jun 05 18:28:52.462240 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.462210 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxvwb_6c0eb43c-04bd-4d81-9a16-1f6ad2757286/node-exporter/0.log" Jun 05 18:28:52.481459 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.481411 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxvwb_6c0eb43c-04bd-4d81-9a16-1f6ad2757286/kube-rbac-proxy/0.log" Jun 05 18:28:52.502465 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:52.502435 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxvwb_6c0eb43c-04bd-4d81-9a16-1f6ad2757286/init-textfile/0.log" Jun 05 18:28:53.149748 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:53.149718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d5c866df4-lkhrs_fe335700-5b5d-4141-be5a-69677bdaad85/thanos-query/0.log" Jun 05 18:28:53.176300 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:53.176258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d5c866df4-lkhrs_fe335700-5b5d-4141-be5a-69677bdaad85/kube-rbac-proxy-web/0.log" Jun 05 18:28:53.203470 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:53.203448 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d5c866df4-lkhrs_fe335700-5b5d-4141-be5a-69677bdaad85/kube-rbac-proxy/0.log" Jun 05 18:28:53.230827 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:53.230803 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d5c866df4-lkhrs_fe335700-5b5d-4141-be5a-69677bdaad85/prom-label-proxy/0.log" Jun 05 18:28:53.257347 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:53.257323 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d5c866df4-lkhrs_fe335700-5b5d-4141-be5a-69677bdaad85/kube-rbac-proxy-rules/0.log" Jun 05 18:28:53.279308 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:53.279280 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d5c866df4-lkhrs_fe335700-5b5d-4141-be5a-69677bdaad85/kube-rbac-proxy-metrics/0.log" Jun 05 18:28:55.959139 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:55.959108 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84c8c785cc-ntldq_eb6ec811-eef7-4ff4-8eda-7d1a4bbe4897/console/0.log" Jun 05 18:28:57.065715 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.065680 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8"] Jun 05 18:28:57.066096 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.066032 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b40af0-a5d1-4349-8406-37a1b2cb9d7d" containerName="istio-proxy" Jun 05 18:28:57.066096 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.066043 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b40af0-a5d1-4349-8406-37a1b2cb9d7d" containerName="istio-proxy" Jun 05 18:28:57.066167 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.066125 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b40af0-a5d1-4349-8406-37a1b2cb9d7d" containerName="istio-proxy" Jun 05 18:28:57.073013 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.072983 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.076540 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.076054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hm5wr\"/\"default-dockercfg-b572z\"" Jun 05 18:28:57.076739 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.076681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8"] Jun 05 18:28:57.077107 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.077084 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm5wr\"/\"kube-root-ca.crt\"" Jun 05 18:28:57.077235 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.077122 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm5wr\"/\"openshift-service-ca.crt\"" Jun 05 18:28:57.223680 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.223615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-proc\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.223680 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.223675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-podres\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.223911 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.223703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-sys\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.223911 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.223771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-lib-modules\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.223911 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.223816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmtd\" (UniqueName: \"kubernetes.io/projected/9d87ea7b-ad68-4018-af60-98e566880480-kube-api-access-dtmtd\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324655 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324550 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-lib-modules\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324655 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmtd\" (UniqueName: \"kubernetes.io/projected/9d87ea7b-ad68-4018-af60-98e566880480-kube-api-access-dtmtd\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-proc\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-podres\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-sys\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-lib-modules\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324785 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-proc\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-sys\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.324886 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.324857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d87ea7b-ad68-4018-af60-98e566880480-podres\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.332321 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.332286 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmtd\" (UniqueName: \"kubernetes.io/projected/9d87ea7b-ad68-4018-af60-98e566880480-kube-api-access-dtmtd\") pod \"perf-node-gather-daemonset-h84f8\" (UID: \"9d87ea7b-ad68-4018-af60-98e566880480\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.385282 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.385244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:57.526360 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.526334 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8"] Jun 05 18:28:57.529095 ip-10-0-128-168 kubenswrapper[2579]: W0605 18:28:57.529064 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9d87ea7b_ad68_4018_af60_98e566880480.slice/crio-6a4c3c5b85d51363122138e8f7033ab3884e38c8a04a0059faab312906c19793 WatchSource:0}: Error finding container 6a4c3c5b85d51363122138e8f7033ab3884e38c8a04a0059faab312906c19793: Status 404 returned error can't find the container with id 6a4c3c5b85d51363122138e8f7033ab3884e38c8a04a0059faab312906c19793 Jun 05 18:28:57.940094 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.940016 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79sgg_2bcf959c-c68e-4a11-9d52-ca73208273b2/dns/0.log" Jun 05 18:28:57.960288 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:57.960258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79sgg_2bcf959c-c68e-4a11-9d52-ca73208273b2/kube-rbac-proxy/0.log" Jun 05 18:28:58.034499 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:58.034464 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" event={"ID":"9d87ea7b-ad68-4018-af60-98e566880480","Type":"ContainerStarted","Data":"94239d5a8f6485efef9cbb7f19e9569b5e02badd6b1ceb681ff2ea0ef7b15f7d"} Jun 05 18:28:58.034748 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:58.034522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" event={"ID":"9d87ea7b-ad68-4018-af60-98e566880480","Type":"ContainerStarted","Data":"6a4c3c5b85d51363122138e8f7033ab3884e38c8a04a0059faab312906c19793"} Jun 05 18:28:58.034748 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:58.034549 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:28:58.052251 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:58.052202 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" podStartSLOduration=1.052185703 podStartE2EDuration="1.052185703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 18:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:28:58.049987108 +0000 UTC m=+2400.078722037" watchObservedRunningTime="2026-06-05 18:28:58.052185703 +0000 UTC m=+2400.080920648" Jun 05 18:28:58.076134 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:58.076100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lf7vp_5be06fc6-2689-4af7-9794-d16f5c8b4ba6/dns-node-resolver/0.log" Jun 05 18:28:58.688213 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:58.688191 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmtjj_18478fc6-df84-4d19-922a-d1b7bb444bb6/node-ca/0.log" Jun 05 18:28:59.652776 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:59.652745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795b82nc_80d00aa8-5fa6-4d15-bd8a-a7613fbb8909/istio-proxy/0.log" Jun 05 18:28:59.793803 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:59.793773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/0.log" Jun 05 18:28:59.824458 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:28:59.824427 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/1.log" Jun 05 18:29:00.562444 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:00.562416 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc2cg_82cd66c7-5022-43c7-9f2e-493580bc9c9b/serve-healthcheck-canary/0.log" Jun 05 18:29:01.148293 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:01.148266 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtkmr_0108c223-738c-48f8-8544-6189d9f7cb65/kube-rbac-proxy/0.log" Jun 05 18:29:01.173025 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:01.173002 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtkmr_0108c223-738c-48f8-8544-6189d9f7cb65/exporter/0.log" Jun 05 18:29:01.195376 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:01.195352 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtkmr_0108c223-738c-48f8-8544-6189d9f7cb65/extractor/0.log" Jun 05 18:29:03.614460 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:03.614429 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dc4bb59b5-8mq9f_7613f619-0a15-4d81-a9f2-b63c74a15ec5/nginx/0.log" Jun 05 18:29:03.777497 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:03.777470 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29678055-zv6xj_173c5e51-c211-49ef-a9bc-21f8c0381632/cleanup/0.log" Jun 05 18:29:03.976319 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:03.976240 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp_5cf8ee0f-6508-4645-bafe-9ca485fbd1e4/manager/0.log" Jun 05 18:29:03.998436 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:03.998413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-6r5mp_5cf8ee0f-6508-4645-bafe-9ca485fbd1e4/copy-manifests/0.log" Jun 05 18:29:04.050236 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:04.050207 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-h84f8" Jun 05 18:29:04.221054 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:04.221025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-g54x6_70e684bc-8e25-4915-afcc-854d02c79869/postgres/0.log" Jun 05 18:29:05.792042 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:05.792008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58878fcd45-vcc8l_2e9a738c-e9ad-4879-8f1f-228406b1e137/manager/0.log" Jun 05 18:29:05.817466 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:05.817438 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6nw4c_543afb2e-cd4d-4184-9baa-e5c83c3140e0/openshift-lws-operator/0.log" Jun 05 18:29:10.105367 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:10.105335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795b82nc_80d00aa8-5fa6-4d15-bd8a-a7613fbb8909/istio-proxy/0.log" Jun 05 18:29:10.217366 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:10.217338 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/0.log" Jun 05 18:29:10.254164 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:10.254130 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/1.log" Jun 05 18:29:11.539827 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:11.539797 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795b82nc_80d00aa8-5fa6-4d15-bd8a-a7613fbb8909/istio-proxy/0.log" Jun 05 18:29:11.645617 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:11.645578 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/0.log" Jun 05 18:29:11.679473 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:11.679436 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/1.log" Jun 05 18:29:13.336036 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.336008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/kube-multus-additional-cni-plugins/0.log" Jun 05 18:29:13.356802 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.356774 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/egress-router-binary-copy/0.log" Jun 05 18:29:13.378764 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.378738 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/cni-plugins/0.log" Jun 05 18:29:13.393711 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.393684 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795b82nc_80d00aa8-5fa6-4d15-bd8a-a7613fbb8909/istio-proxy/0.log" Jun 05 18:29:13.398843 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.398821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/bond-cni-plugin/0.log" Jun 05 18:29:13.421925 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.421891 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/routeoverride-cni/0.log" Jun 05 18:29:13.443045 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.442960 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/whereabouts-cni-bincopy/0.log" Jun 05 18:29:13.462677 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.462649 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whg7s_1e35ae7a-aef8-4911-b663-b7089ce43cf8/whereabouts-cni/0.log" Jun 05 18:29:13.492604 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.492579 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k5gj6_bfbb11d2-706c-4ff3-990a-68c079514c2f/kube-multus/0.log" Jun 05 18:29:13.495244 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.495217 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/0.log" Jun 05 18:29:13.529948 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.529918 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nkhlt_ba18d7ea-dcbe-465c-b1d7-804677a19df9/istio-proxy/1.log" Jun 05 18:29:13.548422 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.548392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh45g_0afed098-ee13-41f5-a7d8-1c245a5127b7/network-metrics-daemon/0.log" Jun 05 18:29:13.568380 ip-10-0-128-168 kubenswrapper[2579]: I0605 18:29:13.568354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh45g_0afed098-ee13-41f5-a7d8-1c245a5127b7/kube-rbac-proxy/0.log"