Aug 04 09:38:20.549313 ip-10-0-135-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 04 09:38:20.549324 ip-10-0-135-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 04 09:38:20.549331 ip-10-0-135-46 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 04 09:38:20.549630 ip-10-0-135-46 systemd[1]: Failed to start Kubernetes Kubelet. Aug 04 09:38:30.781004 ip-10-0-135-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 04 09:38:30.781021 ip-10-0-135-46 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b1f7acd6bdf1487094ed76cfa2917b40 -- Aug 04 09:40:18.360610 ip-10-0-135-46 systemd[1]: Starting Kubernetes Kubelet... Aug 04 09:40:18.727452 ip-10-0-135-46 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 09:40:18.727452 ip-10-0-135-46 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 04 09:40:18.727452 ip-10-0-135-46 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 09:40:18.727452 ip-10-0-135-46 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 04 09:40:18.728007 ip-10-0-135-46 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 09:40:18.728007 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.727528 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 04 09:40:18.731317 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731302 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 09:40:18.731317 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731317 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731321 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731326 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731329 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731332 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731334 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731337 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731340 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731342 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731345 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731348 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731363 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731366 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731369 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731372 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731379 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731383 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731386 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731389 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731392 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 09:40:18.731401 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731395 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731398 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731401 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731404 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731406 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731410 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731413 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731416 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731418 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731421 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731423 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731426 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731429 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731431 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731434 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731436 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731440 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731442 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731445 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 09:40:18.731884 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731447 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731451 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731455 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731457 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731460 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731462 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731465 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731468 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731470 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731473 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731476 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731478 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731481 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731483 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731486 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731489 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731492 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731494 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731497 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 09:40:18.732394 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731499 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731502 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731504 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731507 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731509 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731514 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731517 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731521 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731524 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731527 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731530 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731532 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731535 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731537 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731540 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731543 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731545 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731548 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731551 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731553 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 09:40:18.732851 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731556 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731559 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731561 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731564 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731568 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731571 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731573 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731576 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731580 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731583 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731586 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731589 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731592 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731594 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731597 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731600 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731602 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731605 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731608 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.731610 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 09:40:18.733335 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732275 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732281 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732284 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732287 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732290 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732292 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732295 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732298 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732301 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732304 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732307 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732309 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732312 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732317 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732321 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732324 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732327 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732330 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732333 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 09:40:18.733830 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732336 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732340 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732343 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732346 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732349 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732367 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732370 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732373 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732376 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732379 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732382 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732385 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732387 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732390 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732393 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732396 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732398 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732401 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732405 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732408 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 09:40:18.734309 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732411 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732414 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732416 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732419 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732422 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732425 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732428 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732430 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732434 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732439 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732443 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732446 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732449 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732452 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732455 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732459 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732461 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732464 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732467 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 09:40:18.734828 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732469 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732472 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732474 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732477 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732480 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732483 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732485 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732488 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732490 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732493 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732496 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732498 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732501 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732503 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732505 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732508 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732511 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732513 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732516 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732518 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 09:40:18.735293 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732521 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732523 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732527 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732529 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732532 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732534 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732537 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732539 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732542 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732544 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732547 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732550 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732552 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732555 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732557 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732560 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732563 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732566 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732568 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732571 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 09:40:18.735890 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732573 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732931 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732936 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732941 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732944 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732948 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732951 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732954 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732957 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732959 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732962 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732964 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732967 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732970 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732973 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732975 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732978 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732980 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732983 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732986 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 09:40:18.736402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732988 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732991 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732993 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732996 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.732998 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733001 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733004 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733009 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733012 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733014 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733017 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733019 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733022 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733025 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733028 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733030 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733033 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733035 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733037 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733040 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 09:40:18.736908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733043 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733045 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733048 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733051 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733053 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733056 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733058 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733061 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733064 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733066 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733069 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733072 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733075 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733077 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733080 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733082 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733085 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733087 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733090 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733094 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 09:40:18.737452 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733096 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733099 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733101 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733104 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733106 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733109 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733112 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733114 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733116 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733119 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733122 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733124 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733127 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733129 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733132 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733134 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733137 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733139 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733142 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 09:40:18.737938 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733145 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733148 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733151 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733154 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733157 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733159 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733162 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733164 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733167 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733169 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733172 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733174 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733178 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733181 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733185 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733188 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733191 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733194 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733196 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 09:40:18.738416 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733199 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733202 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733267 2558 flags.go:64] FLAG: --address="0.0.0.0" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733274 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733279 2558 flags.go:64] FLAG: --anonymous-auth="true" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733284 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733287 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733291 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733294 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733299 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733302 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733305 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733308 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733311 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733314 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733318 2558 flags.go:64] FLAG: --cgroup-root="" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733321 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733324 2558 flags.go:64] FLAG: --client-ca-file="" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733328 2558 flags.go:64] FLAG: --cloud-provider="external" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733331 2558 flags.go:64] FLAG: --cluster-dns="[]" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733335 2558 flags.go:64] FLAG: --cluster-domain="" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733338 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733341 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733345 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 04 09:40:18.738879 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733348 2558 flags.go:64] FLAG: --container-log-max-files="5" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733365 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733369 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733372 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733375 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733378 2558 flags.go:64] FLAG: --contention-profiling="false" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733381 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733384 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733387 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733390 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733394 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733397 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733400 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733403 2558 flags.go:64] FLAG: --enable-load-reader="false" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733406 2558 flags.go:64] FLAG: --enable-server="true" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733409 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733413 2558 flags.go:64] FLAG: --event-burst="100" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733416 2558 flags.go:64] FLAG: --event-qps="50" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733419 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733422 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733425 2558 flags.go:64] FLAG: --eviction-hard="" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733428 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733431 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733434 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733439 2558 flags.go:64] FLAG: --eviction-soft="" Aug 04 09:40:18.739461 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733442 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733445 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733448 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733451 2558 flags.go:64] FLAG: --experimental-mounter-path="" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733454 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733457 2558 flags.go:64] FLAG: --fail-swap-on="true" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733460 2558 flags.go:64] FLAG: --feature-gates="" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733463 2558 flags.go:64] FLAG: --file-check-frequency="20s" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733468 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733471 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733474 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733477 2558 flags.go:64] FLAG: --healthz-port="10248" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733479 2558 flags.go:64] FLAG: --help="false" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733483 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-46.ec2.internal" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733486 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733488 2558 flags.go:64] FLAG: --http-check-frequency="20s" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733491 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733495 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733498 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733501 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733504 2558 flags.go:64] FLAG: --image-service-endpoint="" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733506 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733509 2558 flags.go:64] FLAG: --kube-api-burst="100" Aug 04 09:40:18.740100 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733512 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733515 2558 flags.go:64] FLAG: --kube-api-qps="50" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733518 2558 flags.go:64] FLAG: --kube-reserved="" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733521 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733523 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733527 2558 flags.go:64] FLAG: --kubelet-cgroups="" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733530 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733532 2558 flags.go:64] FLAG: --lock-file="" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733536 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733539 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733543 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733548 2558 flags.go:64] FLAG: --log-json-split-stream="false" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733551 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733553 2558 flags.go:64] FLAG: --log-text-split-stream="false" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733556 2558 flags.go:64] FLAG: --logging-format="text" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733559 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733562 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733566 2558 flags.go:64] FLAG: --manifest-url="" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733569 2558 flags.go:64] FLAG: --manifest-url-header="" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733573 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733576 2558 flags.go:64] FLAG: --max-open-files="1000000" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733580 2558 flags.go:64] FLAG: --max-pods="110" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733584 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733587 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733589 2558 flags.go:64] FLAG: --memory-manager-policy="None" Aug 04 09:40:18.740740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733592 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733595 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733599 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733601 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733608 2558 flags.go:64] FLAG: --node-status-max-images="50" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733611 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733614 2558 flags.go:64] FLAG: --oom-score-adj="-999" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733618 2558 flags.go:64] FLAG: --pod-cidr="" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733621 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733626 2558 flags.go:64] FLAG: --pod-manifest-path="" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733628 2558 flags.go:64] FLAG: --pod-max-pids="-1" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733632 2558 flags.go:64] FLAG: --pods-per-core="0" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733635 2558 flags.go:64] FLAG: --port="10250" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733638 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733640 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00a78800449534ad4" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733643 2558 flags.go:64] FLAG: --qos-reserved="" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733648 2558 flags.go:64] FLAG: --read-only-port="10255" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733651 2558 flags.go:64] FLAG: --register-node="true" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733654 2558 flags.go:64] FLAG: --register-with-taints="" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733658 2558 flags.go:64] FLAG: --registry-burst="10" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733660 2558 flags.go:64] FLAG: --registry-qps="5" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733663 2558 flags.go:64] FLAG: --reserved-cpus="" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733666 2558 flags.go:64] FLAG: --reserved-memory="" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733670 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733674 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 04 09:40:18.741362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733677 2558 flags.go:64] FLAG: --rotate-certificates="false" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733680 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733682 2558 flags.go:64] FLAG: --runonce="false" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733685 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733689 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733692 2558 flags.go:64] FLAG: --seccomp-default="false" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733694 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733697 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733700 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733703 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733706 2558 flags.go:64] FLAG: --storage-driver-password="root" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733709 2558 flags.go:64] FLAG: --storage-driver-secure="false" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733712 2558 flags.go:64] FLAG: --storage-driver-table="stats" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733728 2558 flags.go:64] FLAG: --storage-driver-user="root" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733732 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733736 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733739 2558 flags.go:64] FLAG: --system-cgroups="" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733742 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733747 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733750 2558 flags.go:64] FLAG: --tls-cert-file="" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733753 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733758 2558 flags.go:64] FLAG: --tls-min-version="" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733761 2558 flags.go:64] FLAG: --tls-private-key-file="" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733766 2558 flags.go:64] FLAG: --topology-manager-policy="none" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733769 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 04 09:40:18.741980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733772 2558 flags.go:64] FLAG: --topology-manager-scope="container" Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733776 2558 flags.go:64] FLAG: --v="2" Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733779 2558 flags.go:64] FLAG: --version="false" Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733784 2558 flags.go:64] FLAG: --vmodule="" Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733788 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.733791 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733903 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733907 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733910 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733913 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733916 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733919 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733922 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733925 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733928 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733931 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733934 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733936 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733939 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733942 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733945 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 09:40:18.742614 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733947 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733950 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733952 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733956 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733961 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733964 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733968 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733971 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733974 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733978 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733981 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733984 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733987 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733990 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733993 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733995 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.733998 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734001 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 09:40:18.743127 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734004 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734007 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734009 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734012 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734014 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734017 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734020 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734022 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734025 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734027 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734030 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734033 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734035 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734038 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734040 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734043 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734045 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734048 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734051 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734053 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 09:40:18.743627 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734056 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734058 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734061 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734065 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734067 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734070 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734073 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734075 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734078 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734081 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734083 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734086 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734089 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734091 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734094 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734096 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734099 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734102 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734104 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734107 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 09:40:18.744107 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734109 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734112 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734114 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734117 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734120 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734122 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734125 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734127 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734130 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734132 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734135 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734137 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734140 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734143 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734145 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734149 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734152 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734154 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734157 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734159 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 09:40:18.744599 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734163 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734167 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734170 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734174 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734177 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.734180 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.734911 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.741255 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.741270 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.741783 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.741790 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741845 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741850 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741855 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 09:40:18.745070 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741859 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741862 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741865 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741868 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741871 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741874 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741877 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741880 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741882 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741885 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741888 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741890 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741893 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741895 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741898 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741900 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741903 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741905 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741908 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741911 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 04 09:40:18.745429 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741914 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741917 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741919 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741922 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741925 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741927 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741930 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741933 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741935 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741938 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741940 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741943 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741946 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741948 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741951 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741954 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741957 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741959 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741962 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741964 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 09:40:18.745908 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741967 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741969 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741971 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741974 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741976 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741979 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741982 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741984 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741988 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741992 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741996 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.741999 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742002 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742005 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742008 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742010 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742013 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742016 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742019 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742022 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 09:40:18.746449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742024 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742027 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742029 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742032 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742034 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742037 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742040 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742044 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742047 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742050 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742053 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742055 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742058 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742060 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742063 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742066 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742069 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742071 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742074 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742077 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 09:40:18.746940 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742079 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742082 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742085 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742088 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742091 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742094 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742096 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742099 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742102 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742104 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742107 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742110 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742112 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742115 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742117 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 09:40:18.747434 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742120 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.742124 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742232 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742236 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742239 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742242 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742245 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742247 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742250 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742253 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742255 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742257 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742260 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742263 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742265 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 09:40:18.747808 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742268 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742270 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742273 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742276 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742278 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742281 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742284 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742287 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742289 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742292 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742294 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742297 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742299 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742302 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742304 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742307 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742309 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742312 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742314 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742317 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 09:40:18.748178 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742319 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742322 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742324 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742326 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742329 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742331 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742334 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742336 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742339 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742342 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742344 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742347 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742350 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742374 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742379 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742382 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742385 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742405 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742408 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 09:40:18.748727 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742411 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742415 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742418 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742421 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742424 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742426 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742429 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742431 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742434 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742436 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742439 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742442 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742444 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742447 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742450 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742452 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742455 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742457 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742460 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742462 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 09:40:18.749186 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742465 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742467 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742471 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742475 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742478 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742481 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742484 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742487 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742489 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742492 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742494 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742497 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742499 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742502 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742505 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742507 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742510 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742512 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742514 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 09:40:18.749704 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742517 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742519 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742521 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742524 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742527 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742531 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742534 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:18.742536 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.742541 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.742635 2558 server.go:962] "Client rotation is on, will bootstrap in background" Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.744678 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.745998 2558 server.go:1019] "Starting client certificate rotation" Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.746099 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 09:40:18.750164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.746140 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 09:40:18.750593 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.748371 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 09:40:18.753270 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.753250 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 09:40:18.765294 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.765278 2558 log.go:25] "Validated CRI v1 runtime API" Aug 04 09:40:18.769312 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.769295 2558 log.go:25] "Validated CRI v1 image API" Aug 04 09:40:18.770109 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.770095 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 04 09:40:18.772332 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.772314 2558 fs.go:135] Filesystem UUIDs: map[3c665636-bb01-4ff2-8622-eb28d695d499:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f475b30a-e98d-41ef-a576-490c7b0badf0:/dev/nvme0n1p4] Aug 04 09:40:18.772425 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.772332 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 04 09:40:18.777740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.777631 2558 manager.go:216] Machine: {Timestamp:2026-08-04 09:40:18.776190663 +0000 UTC m=+0.307639922 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101264 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8c416eb33a3d3f367f8d05646f3d SystemUUID:ec2a8c41-6eb3-3a3d-3f36-7f8d05646f3d BootID:b1f7acd6-bdf1-4870-94ed-76cfa2917b40 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:29:a8:fc:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:29:a8:fc:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:b6:44:7d:76:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 04 09:40:18.777740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.777731 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 04 09:40:18.777876 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.777827 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 04 09:40:18.780805 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.780780 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 04 09:40:18.780973 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.780808 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 04 09:40:18.781578 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.781566 2558 topology_manager.go:138] "Creating topology manager with none policy" Aug 04 09:40:18.781641 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.781584 2558 container_manager_linux.go:309] "Creating device plugin manager" Aug 04 09:40:18.781641 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.781594 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 09:40:18.781641 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.781614 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 09:40:18.782253 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.782234 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 09:40:18.782465 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.782454 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 04 09:40:18.786903 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.786891 2558 state_mem.go:36] "Initialized new in-memory state store" Aug 04 09:40:18.787012 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787003 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 04 09:40:18.787044 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787030 2558 kubelet.go:486] "Attempting to sync node with API server" Aug 04 09:40:18.787044 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787039 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 04 09:40:18.787108 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787049 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 04 09:40:18.787108 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787057 2558 kubelet.go:398] "Adding apiserver pod source" Aug 04 09:40:18.787108 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787066 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 04 09:40:18.787462 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787447 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 09:40:18.787521 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.787474 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 09:40:18.789335 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.789319 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 04 09:40:18.790610 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.790597 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 04 09:40:18.790662 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.790627 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 04 09:40:18.791756 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791745 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 04 09:40:18.791790 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791761 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 04 09:40:18.791790 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791767 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 04 09:40:18.791790 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791773 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 04 09:40:18.791790 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791786 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791794 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791804 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791809 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791815 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791820 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791829 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 04 09:40:18.791893 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.791835 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 04 09:40:18.792633 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.792621 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 04 09:40:18.792664 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.792636 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 04 09:40:18.796193 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.796175 2558 server.go:1268] "Started kubelet" Aug 04 09:40:18.796695 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.796617 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 04 09:40:18.797121 ip-10-0-135-46 systemd[1]: Started Kubernetes Kubelet. Aug 04 09:40:18.797478 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.797379 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 04 09:40:18.797570 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.797498 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 04 09:40:18.798743 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.798553 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 04 09:40:18.798743 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.798579 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 04 09:40:18.798743 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.798613 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 04 09:40:18.798743 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.798678 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 04 09:40:18.799972 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.799953 2558 server.go:310] "Adding debug handlers to kubelet server" Aug 04 09:40:18.802670 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.802635 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 04 09:40:18.804970 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.804952 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 04 09:40:18.804970 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.804963 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 04 09:40:18.805119 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.805054 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:18.805171 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.804320 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-46.ec2.internal.18c890c2d94cb6d8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-46.ec2.internal,UID:ip-10-0-135-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-46.ec2.internal,},FirstTimestamp:2026-08-04 09:40:18.796140248 +0000 UTC m=+0.327589504,LastTimestamp:2026-08-04 09:40:18.796140248 +0000 UTC m=+0.327589504,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-46.ec2.internal,}" Aug 04 09:40:18.805687 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.805673 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 04 09:40:18.805800 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.805681 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 04 09:40:18.805863 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.805805 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 04 09:40:18.805979 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.805963 2558 reconstruct.go:97] "Volume reconstruction finished" Aug 04 09:40:18.805979 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.805978 2558 reconciler.go:29] "Reconciler: start to sync state" Aug 04 09:40:18.806086 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806036 2558 factory.go:153] Registering CRI-O factory Aug 04 09:40:18.806086 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806048 2558 factory.go:223] Registration of the crio container factory successfully Aug 04 09:40:18.806180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806103 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 04 09:40:18.806180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806112 2558 factory.go:55] Registering systemd factory Aug 04 09:40:18.806180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806119 2558 factory.go:223] Registration of the systemd container factory successfully Aug 04 09:40:18.806180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806138 2558 factory.go:103] Registering Raw factory Aug 04 09:40:18.806180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806152 2558 manager.go:1196] Started watching for new ooms in manager Aug 04 09:40:18.806558 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.806544 2558 manager.go:349] Starting recovery of all containers Aug 04 09:40:18.812854 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.812821 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 04 09:40:18.812963 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.812946 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 04 09:40:18.818287 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.818270 2558 manager.go:354] Recovery completed Aug 04 09:40:18.824145 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.824132 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:18.825957 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.825925 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:18.826032 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.825979 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:18.826032 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.825996 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:18.828992 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.828976 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 04 09:40:18.828992 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.828990 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 04 09:40:18.829131 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.829005 2558 state_mem.go:36] "Initialized new in-memory state store" Aug 04 09:40:18.829131 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.828989 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:18.829396 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.829318 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-46.ec2.internal.18c890c2db13b0c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-46.ec2.internal,UID:ip-10-0-135-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-46.ec2.internal,},FirstTimestamp:2026-08-04 09:40:18.825957572 +0000 UTC m=+0.357406829,LastTimestamp:2026-08-04 09:40:18.825957572 +0000 UTC m=+0.357406829,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-46.ec2.internal,}" Aug 04 09:40:18.829855 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.829840 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:18.829926 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.829866 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:18.829926 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.829880 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:18.831318 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.831306 2558 policy_none.go:49] "None policy: Start" Aug 04 09:40:18.831378 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.831322 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 04 09:40:18.831378 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.831332 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 04 09:40:18.833247 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.833236 2558 policy_none.go:47] "Start" Aug 04 09:40:18.839495 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.839434 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-46.ec2.internal.18c890c2db142132 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-46.ec2.internal,UID:ip-10-0-135-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-46.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-46.ec2.internal,},FirstTimestamp:2026-08-04 09:40:18.825986354 +0000 UTC m=+0.357435607,LastTimestamp:2026-08-04 09:40:18.825986354 +0000 UTC m=+0.357435607,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-46.ec2.internal,}" Aug 04 09:40:18.840618 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.840604 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r65jk" Aug 04 09:40:18.844273 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.844216 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-46.ec2.internal.18c890c2db145edd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-46.ec2.internal,UID:ip-10-0-135-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-46.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-46.ec2.internal,},FirstTimestamp:2026-08-04 09:40:18.826002141 +0000 UTC m=+0.357451393,LastTimestamp:2026-08-04 09:40:18.826002141 +0000 UTC m=+0.357451393,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-46.ec2.internal,}" Aug 04 09:40:18.846947 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.846927 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r65jk" Aug 04 09:40:18.849050 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.848911 2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-46.ec2.internal.18c890c2db13b0c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-46.ec2.internal.18c890c2db13b0c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-46.ec2.internal,UID:ip-10-0-135-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-46.ec2.internal,},FirstTimestamp:2026-08-04 09:40:18.825957572 +0000 UTC m=+0.357406829,LastTimestamp:2026-08-04 09:40:18.829854226 +0000 UTC m=+0.361303475,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-46.ec2.internal,}" Aug 04 09:40:18.876926 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.876909 2558 manager.go:337] "Starting Device Plugin manager" Aug 04 09:40:18.877009 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.876936 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 04 09:40:18.877009 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.876944 2558 server.go:87] "Starting device plugin registration server" Aug 04 09:40:18.877152 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.877140 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 04 09:40:18.877203 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.877155 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 04 09:40:18.877270 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.877254 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 04 09:40:18.877343 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.877331 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 04 09:40:18.877403 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.877347 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 04 09:40:18.877876 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.877856 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 04 09:40:18.877954 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.877908 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:18.898071 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.898048 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 04 09:40:18.908026 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.899114 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 04 09:40:18.908026 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.899160 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 04 09:40:18.908026 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.899184 2558 kubelet.go:2448] "Starting kubelet main sync loop" Aug 04 09:40:18.908026 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.899236 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 04 09:40:18.908026 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.901760 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 09:40:18.978183 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.978132 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:18.979445 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.979433 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:18.979508 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.979460 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:18.979508 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.979470 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:18.979508 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.979496 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-46.ec2.internal" Aug 04 09:40:18.988607 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.988589 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-46.ec2.internal" Aug 04 09:40:18.988691 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:18.988610 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-46.ec2.internal\": node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:18.999507 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.999486 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal"] Aug 04 09:40:18.999580 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:18.999532 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:19.000942 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.000928 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:19.001008 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.000954 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:19.001008 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.000963 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:19.003034 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003022 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:19.003133 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003120 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.003173 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003146 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:19.003687 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003673 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:19.003754 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003694 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:19.003754 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003707 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:19.003836 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003771 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:19.003836 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003791 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:19.003836 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.003801 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:19.005871 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.005857 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.005962 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.005880 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:19.006564 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.006549 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:19.006637 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.006571 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:19.006637 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.006583 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:19.007836 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.007816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b35fbf4a1c54155dd094f2a5f87502ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal\" (UID: \"b35fbf4a1c54155dd094f2a5f87502ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.007885 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.007854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8145c81afbc54966ebe426cd3860b587-config\") pod \"kube-apiserver-proxy-ip-10-0-135-46.ec2.internal\" (UID: \"8145c81afbc54966ebe426cd3860b587\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.007925 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.007881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b35fbf4a1c54155dd094f2a5f87502ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal\" (UID: \"b35fbf4a1c54155dd094f2a5f87502ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.029251 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:19.029230 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:19.032839 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:19.032823 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-46.ec2.internal\" not found" node="ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.037203 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:19.037187 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-46.ec2.internal\" not found" node="ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.108205 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.108181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8145c81afbc54966ebe426cd3860b587-config\") pod \"kube-apiserver-proxy-ip-10-0-135-46.ec2.internal\" (UID: \"8145c81afbc54966ebe426cd3860b587\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.108297 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.108209 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b35fbf4a1c54155dd094f2a5f87502ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal\" (UID: \"b35fbf4a1c54155dd094f2a5f87502ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.108297 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.108224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b35fbf4a1c54155dd094f2a5f87502ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal\" (UID: \"b35fbf4a1c54155dd094f2a5f87502ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.108297 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.108260 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b35fbf4a1c54155dd094f2a5f87502ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal\" (UID: \"b35fbf4a1c54155dd094f2a5f87502ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.108297 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.108294 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b35fbf4a1c54155dd094f2a5f87502ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal\" (UID: \"b35fbf4a1c54155dd094f2a5f87502ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.108455 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:19.108294 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8145c81afbc54966ebe426cd3860b587-config\") pod \"kube-apiserver-proxy-ip-10-0-135-46.ec2.internal\" (UID: \"8145c81afbc54966ebe426cd3860b587\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" Aug 04 09:40:19.130155 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:19.130137 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.343182 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.343132 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.443934 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.443904 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.448075 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.448061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" Aug 04 09:40:20.451914 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.451893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:20.544864 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.544842 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.645363 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.645317 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.745830 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.745807 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.846357 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.846327 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.857485 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.857468 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 04 09:40:20.857654 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.857635 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 04 09:40:20.947233 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:20.947181 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:20.954325 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.954305 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 09:40:20.955599 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.955566 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientMemory" Aug 04 09:40:20.955676 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.955618 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 09:40:20.955676 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.955628 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeHasSufficientPID" Aug 04 09:40:20.962064 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:20.962036 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8145c81afbc54966ebe426cd3860b587.slice/crio-ef805f33320c794dea478eb866fa33665c0bdd23a0203b1ca08f1cce569dcaea WatchSource:0}: Error finding container ef805f33320c794dea478eb866fa33665c0bdd23a0203b1ca08f1cce569dcaea: Status 404 returned error can't find the container with id ef805f33320c794dea478eb866fa33665c0bdd23a0203b1ca08f1cce569dcaea Aug 04 09:40:20.962402 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:20.962387 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35fbf4a1c54155dd094f2a5f87502ea.slice/crio-f89ae3ed785fd5f2f551b68544962aea67c70fe6ba0c7628e90393f7fb805ba1 WatchSource:0}: Error finding container f89ae3ed785fd5f2f551b68544962aea67c70fe6ba0c7628e90393f7fb805ba1: Status 404 returned error can't find the container with id f89ae3ed785fd5f2f551b68544962aea67c70fe6ba0c7628e90393f7fb805ba1 Aug 04 09:40:20.965055 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.963734 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 09:35:19 +0000 UTC" deadline="2028-02-03 16:45:24.265406191 +0000 UTC" Aug 04 09:40:20.965055 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.963769 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13159h5m3.301641356s" Aug 04 09:40:20.967976 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:20.967920 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 09:40:21.015509 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.015467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" event={"ID":"b35fbf4a1c54155dd094f2a5f87502ea","Type":"ContainerStarted","Data":"f89ae3ed785fd5f2f551b68544962aea67c70fe6ba0c7628e90393f7fb805ba1"} Aug 04 09:40:21.016869 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.016848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" event={"ID":"8145c81afbc54966ebe426cd3860b587","Type":"ContainerStarted","Data":"ef805f33320c794dea478eb866fa33665c0bdd23a0203b1ca08f1cce569dcaea"} Aug 04 09:40:21.040244 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.040221 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 09:40:21.047836 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:21.047817 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:21.148355 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:21.148335 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-46.ec2.internal\" not found" Aug 04 09:40:21.192356 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.192337 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 09:40:21.217506 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.217455 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" Aug 04 09:40:21.237729 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.237713 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 09:40:21.239404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.239392 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" Aug 04 09:40:21.252187 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.252170 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 09:40:21.496788 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.496729 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 09:40:21.900271 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.900195 2558 apiserver.go:52] "Watching apiserver" Aug 04 09:40:21.907184 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.907160 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 04 09:40:21.907662 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.907631 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qvmtr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm","openshift-cluster-node-tuning-operator/tuned-fhnj7","openshift-dns/node-resolver-nmq98","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal","openshift-multus/network-metrics-daemon-lw6n5","openshift-network-diagnostics/network-check-target-kmwm4","kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal","openshift-image-registry/node-ca-kmc44","openshift-multus/multus-additional-cni-plugins-s5884","openshift-multus/multus-jd726","openshift-network-operator/iptables-alerter-jj4kb","openshift-ovn-kubernetes/ovnkube-node-btz6g","kube-system/global-pull-secret-syncer-bqbtw"] Aug 04 09:40:21.910157 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.910133 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:21.910275 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:21.910215 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:21.912436 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.912415 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jd726" Aug 04 09:40:21.914634 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.914612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.915079 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.915061 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.915290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.915274 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 04 09:40:21.915367 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.915272 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.915424 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.915399 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 04 09:40:21.915562 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.915549 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dz4lf\"" Aug 04 09:40:21.916887 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.916867 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:21.917082 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.917063 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z6xsp\"" Aug 04 09:40:21.917308 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.917288 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.917548 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.917532 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 04 09:40:21.917648 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.917548 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.919073 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.919053 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:21.919196 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:21.919176 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:21.919508 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.919489 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.920074 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.919903 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zr5l8\"" Aug 04 09:40:21.920074 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.919916 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.922729 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.922711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:21.922826 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:21.922785 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:21.925288 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.925268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:21.927728 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.927708 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hwpqk\"" Aug 04 09:40:21.927819 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.927775 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 04 09:40:21.927887 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.927716 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.927939 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.927777 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:21.928030 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.927709 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.929234 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.929214 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 09:40:21.930319 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930302 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:21.930407 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930355 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 04 09:40:21.930777 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d13f5287-40a5-4a12-ae23-058ed3e504ee-cni-binary-copy\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.930873 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-k8s-cni-cncf-io\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.930873 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-lib-modules\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.930873 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-var-lib-kubelet\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.930873 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930850 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 04 09:40:21.930873 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930860 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-host\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.931152 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7aadecf-401d-423a-a2c7-135c80d8be14-tmp-dir\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:21.931152 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-cni-multus\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931152 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930942 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.931152 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931090 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vm472\"" Aug 04 09:40:21.931152 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931135 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 04 09:40:21.931384 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931223 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 04 09:40:21.931384 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931322 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.931384 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.930945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-kubelet\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-run\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.931523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:21.931523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931440 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-socket-dir-parent\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-netns\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-conf-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-etc-kubernetes\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-modprobe-d\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysctl-d\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-tmp\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p696\" (UniqueName: \"kubernetes.io/projected/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-kube-api-access-8p696\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931672 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-cni-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.931773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-hostroot\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-multus-certs\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq6xk\" (UniqueName: \"kubernetes.io/projected/d13f5287-40a5-4a12-ae23-058ed3e504ee-kube-api-access-nq6xk\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-kubernetes\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-tuned\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5605a405-1153-49fc-8cf9-34163351875a-dbus\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-os-release\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-daemon-config\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.931968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysconfig\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7aadecf-401d-423a-a2c7-135c80d8be14-hosts-file\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-cnibin\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-cni-bin\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932068 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932067 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-systemd\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.932523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-sys\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.932523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnsh\" (UniqueName: \"kubernetes.io/projected/a7aadecf-401d-423a-a2c7-135c80d8be14-kube-api-access-qcnsh\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:21.932523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5605a405-1153-49fc-8cf9-34163351875a-kubelet-config\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:21.932523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-system-cni-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:21.932523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysctl-conf\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:21.932776 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.932569 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:21.933434 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.933414 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 04 09:40:21.933666 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.933422 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vp76h\"" Aug 04 09:40:21.933666 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.933610 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.934198 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.934183 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.934949 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.934932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:21.937154 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937136 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 04 09:40:21.937243 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937146 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 04 09:40:21.937243 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937209 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-npfrv\"" Aug 04 09:40:21.937433 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937415 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:21.937623 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937606 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 04 09:40:21.938090 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937917 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 04 09:40:21.938090 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.937937 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-86j4v\"" Aug 04 09:40:21.939805 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.939788 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 04 09:40:21.940684 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.940664 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w25xg\"" Aug 04 09:40:21.940684 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.940673 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 04 09:40:21.940829 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.940769 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 04 09:40:21.954959 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.954937 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xmpc" Aug 04 09:40:21.961786 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:21.961764 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xmpc" Aug 04 09:40:22.019205 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.019186 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 04 09:40:22.033175 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovnkube-config\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033291 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.033291 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033204 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/730ebc68-1237-4215-8d3f-b098d50a944b-host-slash\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.033291 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.033291 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-etc-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033295 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-cni-bin\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-device-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-kubelet\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-slash\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-systemd\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-env-overrides\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d13f5287-40a5-4a12-ae23-058ed3e504ee-cni-binary-copy\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-var-lib-kubelet\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-cni-netd\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-run\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.033679 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033688 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-var-lib-kubelet\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8-konnectivity-ca\") pod \"konnectivity-agent-qvmtr\" (UID: \"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8\") " pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.033746 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:40:22.533728081 +0000 UTC m=+2.952954241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-serviceca\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.033817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-socket-dir-parent\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033824 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-run\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-netns\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033875 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-socket-dir-parent\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-tmp\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033903 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-netns\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p696\" (UniqueName: \"kubernetes.io/projected/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-kube-api-access-8p696\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.033971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-run-ovn-kubernetes\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034031 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-cni-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d13f5287-40a5-4a12-ae23-058ed3e504ee-cni-binary-copy\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-hostroot\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-hostroot\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034179 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034184 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-multus-certs\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-tuned\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5605a405-1153-49fc-8cf9-34163351875a-dbus\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034240 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-cni-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.034404 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-os-release\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5605a405-1153-49fc-8cf9-34163351875a-dbus\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7aadecf-401d-423a-a2c7-135c80d8be14-hosts-file\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-cnibin\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-log-socket\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034388 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-multus-certs\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovn-node-metrics-cert\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034493 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-os-release\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034498 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7aadecf-401d-423a-a2c7-135c80d8be14-hosts-file\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-socket-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-cni-bin\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034613 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-cni-bin\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-systemd\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnsh\" (UniqueName: \"kubernetes.io/projected/a7aadecf-401d-423a-a2c7-135c80d8be14-kube-api-access-qcnsh\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.035231 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5605a405-1153-49fc-8cf9-34163351875a-kubelet-config\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034716 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-systemd\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-systemd-units\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034780 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5605a405-1153-49fc-8cf9-34163351875a-kubelet-config\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034831 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-ovn\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovnkube-script-lib\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-system-cni-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysctl-conf\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-system-cni-dir\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw45h\" (UniqueName: \"kubernetes.io/projected/2ae9f655-9221-43b6-af40-f66137cf3dd1-kube-api-access-xw45h\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dflp\" (UniqueName: \"kubernetes.io/projected/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-kube-api-access-5dflp\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034959 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-system-cni-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.034970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgtsx\" (UniqueName: \"kubernetes.io/projected/42a2656b-b4de-4720-955d-ece4df1db68d-kube-api-access-wgtsx\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-478nl\" (UniqueName: \"kubernetes.io/projected/730ebc68-1237-4215-8d3f-b098d50a944b-kube-api-access-478nl\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035030 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2cxk\" (UniqueName: \"kubernetes.io/projected/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-kube-api-access-q2cxk\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.036025 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035075 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysctl-conf\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035107 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-k8s-cni-cncf-io\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-lib-modules\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035155 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-host\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035162 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-run-k8s-cni-cncf-io\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035178 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7aadecf-401d-423a-a2c7-135c80d8be14-tmp-dir\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-os-release\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035214 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-host\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8-agent-certs\") pod \"konnectivity-agent-qvmtr\" (UID: \"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8\") " pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-cni-multus\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035270 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-lib-modules\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-kubelet\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/730ebc68-1237-4215-8d3f-b098d50a944b-iptables-alerter-script\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-kubelet\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2rph\" (UniqueName: \"kubernetes.io/projected/5e5c4026-5523-47f3-a755-deffb7dd20a6-kube-api-access-z2rph\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-conf-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.036837 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035375 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-host-var-lib-cni-multus\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-etc-kubernetes\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-modprobe-d\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035427 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-conf-dir\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysctl-d\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035459 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-var-lib-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035465 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-etc-kubernetes\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq6xk\" (UniqueName: \"kubernetes.io/projected/d13f5287-40a5-4a12-ae23-058ed3e504ee-kube-api-access-nq6xk\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-kubernetes\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035527 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7aadecf-401d-423a-a2c7-135c80d8be14-tmp-dir\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-node-log\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035560 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysctl-d\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-registration-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-sys-fs\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035638 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-kubernetes\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-daemon-config\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-modprobe-d\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.037587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysconfig\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-host\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-cnibin\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-sys\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035752 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-sysconfig\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-run-netns\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035807 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d13f5287-40a5-4a12-ae23-058ed3e504ee-cnibin\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.035813 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-sys\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.036109 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d13f5287-40a5-4a12-ae23-058ed3e504ee-multus-daemon-config\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.037487 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-etc-tuned\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.038167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.037559 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-tmp\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.043856 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.043837 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:22.043856 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.043857 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:22.044026 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.043867 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:22.044026 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.043919 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:40:22.543900839 +0000 UTC m=+2.963127023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:22.047235 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.047211 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnsh\" (UniqueName: \"kubernetes.io/projected/a7aadecf-401d-423a-a2c7-135c80d8be14-kube-api-access-qcnsh\") pod \"node-resolver-nmq98\" (UID: \"a7aadecf-401d-423a-a2c7-135c80d8be14\") " pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.048067 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.048039 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p696\" (UniqueName: \"kubernetes.io/projected/86dfcd78-93ff-4f27-a6b9-228636c6ab8b-kube-api-access-8p696\") pod \"tuned-fhnj7\" (UID: \"86dfcd78-93ff-4f27-a6b9-228636c6ab8b\") " pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.048396 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.048375 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq6xk\" (UniqueName: \"kubernetes.io/projected/d13f5287-40a5-4a12-ae23-058ed3e504ee-kube-api-access-nq6xk\") pod \"multus-jd726\" (UID: \"d13f5287-40a5-4a12-ae23-058ed3e504ee\") " pod="openshift-multus/multus-jd726" Aug 04 09:40:22.136807 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136781 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.136916 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.136916 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-cnibin\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.136916 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-log-socket\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.136916 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovn-node-metrics-cert\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.136916 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-socket-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-cnibin\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-log-socket\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136969 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-systemd-units\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.136989 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137036 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-systemd-units\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-ovn\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137072 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovnkube-script-lib\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137076 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137079 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-ovn\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137046 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-socket-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-system-cni-dir\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw45h\" (UniqueName: \"kubernetes.io/projected/2ae9f655-9221-43b6-af40-f66137cf3dd1-kube-api-access-xw45h\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dflp\" (UniqueName: \"kubernetes.io/projected/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-kube-api-access-5dflp\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgtsx\" (UniqueName: \"kubernetes.io/projected/42a2656b-b4de-4720-955d-ece4df1db68d-kube-api-access-wgtsx\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137179 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-system-cni-dir\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-478nl\" (UniqueName: \"kubernetes.io/projected/730ebc68-1237-4215-8d3f-b098d50a944b-kube-api-access-478nl\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137216 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2cxk\" (UniqueName: \"kubernetes.io/projected/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-kube-api-access-q2cxk\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-os-release\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137294 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8-agent-certs\") pod \"konnectivity-agent-qvmtr\" (UID: \"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8\") " pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/730ebc68-1237-4215-8d3f-b098d50a944b-iptables-alerter-script\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2rph\" (UniqueName: \"kubernetes.io/projected/5e5c4026-5523-47f3-a755-deffb7dd20a6-kube-api-access-z2rph\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-var-lib-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-node-log\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-registration-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-sys-fs\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-host\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-run-netns\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovnkube-config\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137572 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.137986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/730ebc68-1237-4215-8d3f-b098d50a944b-host-slash\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137650 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovnkube-script-lib\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-etc-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-cni-bin\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-device-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-kubelet\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-slash\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-systemd\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-env-overrides\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137892 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137896 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-device-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-cni-netd\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137942 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-etc-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137945 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-cni-bin\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8-konnectivity-ca\") pod \"konnectivity-agent-qvmtr\" (UID: \"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8\") " pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.138867 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137981 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-run-systemd\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137987 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-kubelet\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138019 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-slash\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-serviceca\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138031 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138056 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-run-ovn-kubernetes\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-cni-netd\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138097 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.138103 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.138160 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:22.638144836 +0000 UTC m=+3.057370997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ae9f655-9221-43b6-af40-f66137cf3dd1-os-release\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138334 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-run-ovn-kubernetes\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138390 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-sys-fs\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138426 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-env-overrides\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138531 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-serviceca\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138625 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-var-lib-openvswitch\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.139595 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138631 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/730ebc68-1237-4215-8d3f-b098d50a944b-iptables-alerter-script\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.137455 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ae9f655-9221-43b6-af40-f66137cf3dd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138673 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138681 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-node-log\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138701 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/730ebc68-1237-4215-8d3f-b098d50a944b-host-slash\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138722 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-host\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138725 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42a2656b-b4de-4720-955d-ece4df1db68d-registration-dir\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138743 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-host-run-netns\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138777 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8-konnectivity-ca\") pod \"konnectivity-agent-qvmtr\" (UID: \"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8\") " pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.138917 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovnkube-config\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.139810 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8-agent-certs\") pod \"konnectivity-agent-qvmtr\" (UID: \"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8\") " pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.140290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.140170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-ovn-node-metrics-cert\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.152512 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.152458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-478nl\" (UniqueName: \"kubernetes.io/projected/730ebc68-1237-4215-8d3f-b098d50a944b-kube-api-access-478nl\") pod \"iptables-alerter-jj4kb\" (UID: \"730ebc68-1237-4215-8d3f-b098d50a944b\") " pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.152638 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.152620 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2rph\" (UniqueName: \"kubernetes.io/projected/5e5c4026-5523-47f3-a755-deffb7dd20a6-kube-api-access-z2rph\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:22.152855 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.152834 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgtsx\" (UniqueName: \"kubernetes.io/projected/42a2656b-b4de-4720-955d-ece4df1db68d-kube-api-access-wgtsx\") pod \"aws-ebs-csi-driver-node-zcnmm\" (UID: \"42a2656b-b4de-4720-955d-ece4df1db68d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.152952 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.152936 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw45h\" (UniqueName: \"kubernetes.io/projected/2ae9f655-9221-43b6-af40-f66137cf3dd1-kube-api-access-xw45h\") pod \"multus-additional-cni-plugins-s5884\" (UID: \"2ae9f655-9221-43b6-af40-f66137cf3dd1\") " pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.153230 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.153212 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dflp\" (UniqueName: \"kubernetes.io/projected/fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72-kube-api-access-5dflp\") pod \"ovnkube-node-btz6g\" (UID: \"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72\") " pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.153230 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.153222 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2cxk\" (UniqueName: \"kubernetes.io/projected/fab1e12f-9f21-4e2b-a37d-5294a721a4f6-kube-api-access-q2cxk\") pod \"node-ca-kmc44\" (UID: \"fab1e12f-9f21-4e2b-a37d-5294a721a4f6\") " pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.224167 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.224135 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jd726" Aug 04 09:40:22.231170 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.231144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" Aug 04 09:40:22.239807 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.239787 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nmq98" Aug 04 09:40:22.245228 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.245212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmc44" Aug 04 09:40:22.251870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.251854 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:22.259560 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.259540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" Aug 04 09:40:22.268548 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.268532 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s5884" Aug 04 09:40:22.275136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.275120 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:22.281514 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.281492 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jj4kb" Aug 04 09:40:22.355299 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.355270 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 09:40:22.541542 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.541472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:22.541673 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.541591 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:22.541673 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.541644 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:40:23.541630824 +0000 UTC m=+3.960856981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:22.642667 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.642624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:22.642667 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.642669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:22.642898 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.642797 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:22.642898 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.642814 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:22.642898 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.642835 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:22.642898 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.642848 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:22.642898 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.642879 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:23.642859983 +0000 UTC m=+4.062086155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:22.642898 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:22.642900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:40:23.642890388 +0000 UTC m=+4.062116544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:22.840197 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.840154 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab1e12f_9f21_4e2b_a37d_5294a721a4f6.slice/crio-a62dd1be6b6c3a7fafba3962e368adee723d541bacb5cfabb473174797a51dd7 WatchSource:0}: Error finding container a62dd1be6b6c3a7fafba3962e368adee723d541bacb5cfabb473174797a51dd7: Status 404 returned error can't find the container with id a62dd1be6b6c3a7fafba3962e368adee723d541bacb5cfabb473174797a51dd7 Aug 04 09:40:22.863476 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.863449 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ffd253_f2c1_4d20_a86a_58ffd7cb69d8.slice/crio-c23e79967f93d2e3c273a6debb9465354ffe27907b3ae758887d946bbdbd616c WatchSource:0}: Error finding container c23e79967f93d2e3c273a6debb9465354ffe27907b3ae758887d946bbdbd616c: Status 404 returned error can't find the container with id c23e79967f93d2e3c273a6debb9465354ffe27907b3ae758887d946bbdbd616c Aug 04 09:40:22.867722 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.867682 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13f5287_40a5_4a12_ae23_058ed3e504ee.slice/crio-8be64a79350293990f22eb514e2d29c13b34587c51938073099e2a541c21cb8d WatchSource:0}: Error finding container 8be64a79350293990f22eb514e2d29c13b34587c51938073099e2a541c21cb8d: Status 404 returned error can't find the container with id 8be64a79350293990f22eb514e2d29c13b34587c51938073099e2a541c21cb8d Aug 04 09:40:22.869906 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.869692 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dfcd78_93ff_4f27_a6b9_228636c6ab8b.slice/crio-9f3f7ec9cc714dbf7c954b88f9c6dd8e23a9c1505d7486495bfab982eb4786c0 WatchSource:0}: Error finding container 9f3f7ec9cc714dbf7c954b88f9c6dd8e23a9c1505d7486495bfab982eb4786c0: Status 404 returned error can't find the container with id 9f3f7ec9cc714dbf7c954b88f9c6dd8e23a9c1505d7486495bfab982eb4786c0 Aug 04 09:40:22.871019 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.870993 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730ebc68_1237_4215_8d3f_b098d50a944b.slice/crio-3ec3e0e5f84a921886895340b6f94069eb9de9b8721eecb7420811f7603ffab1 WatchSource:0}: Error finding container 3ec3e0e5f84a921886895340b6f94069eb9de9b8721eecb7420811f7603ffab1: Status 404 returned error can't find the container with id 3ec3e0e5f84a921886895340b6f94069eb9de9b8721eecb7420811f7603ffab1 Aug 04 09:40:22.872183 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.872157 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7aadecf_401d_423a_a2c7_135c80d8be14.slice/crio-239a3773c8f88bb2c411b6a1fd27406f5125ea9468e017871efeb7b8c811e8a3 WatchSource:0}: Error finding container 239a3773c8f88bb2c411b6a1fd27406f5125ea9468e017871efeb7b8c811e8a3: Status 404 returned error can't find the container with id 239a3773c8f88bb2c411b6a1fd27406f5125ea9468e017871efeb7b8c811e8a3 Aug 04 09:40:22.872987 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.872966 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a2656b_b4de_4720_955d_ece4df1db68d.slice/crio-ead02ad36d9a650630eec502b16c86c498f128414310bbd8d8b3072287c10b9c WatchSource:0}: Error finding container ead02ad36d9a650630eec502b16c86c498f128414310bbd8d8b3072287c10b9c: Status 404 returned error can't find the container with id ead02ad36d9a650630eec502b16c86c498f128414310bbd8d8b3072287c10b9c Aug 04 09:40:22.874540 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.874269 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3e50a3_efe5_4d1e_bf9c_7008d3fb0f72.slice/crio-52948f470254e69048926cf16afb1ac4947edf013ecb330e5901a9fcd760a8c4 WatchSource:0}: Error finding container 52948f470254e69048926cf16afb1ac4947edf013ecb330e5901a9fcd760a8c4: Status 404 returned error can't find the container with id 52948f470254e69048926cf16afb1ac4947edf013ecb330e5901a9fcd760a8c4 Aug 04 09:40:22.875845 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:22.875822 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae9f655_9221_43b6_af40_f66137cf3dd1.slice/crio-5f4d309aa1fe3a18babf5c8846740e779d2b827f9249b2e84490b94d348b50b2 WatchSource:0}: Error finding container 5f4d309aa1fe3a18babf5c8846740e779d2b827f9249b2e84490b94d348b50b2: Status 404 returned error can't find the container with id 5f4d309aa1fe3a18babf5c8846740e779d2b827f9249b2e84490b94d348b50b2 Aug 04 09:40:22.964934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.964902 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 09:35:21 +0000 UTC" deadline="2028-03-11 13:26:08.947676717 +0000 UTC" Aug 04 09:40:22.964934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:22.964935 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14043h45m45.982747161s" Aug 04 09:40:23.019812 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.019783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" event={"ID":"86dfcd78-93ff-4f27-a6b9-228636c6ab8b","Type":"ContainerStarted","Data":"9f3f7ec9cc714dbf7c954b88f9c6dd8e23a9c1505d7486495bfab982eb4786c0"} Aug 04 09:40:23.020844 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.020823 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qvmtr" event={"ID":"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8","Type":"ContainerStarted","Data":"c23e79967f93d2e3c273a6debb9465354ffe27907b3ae758887d946bbdbd616c"} Aug 04 09:40:23.021752 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.021731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmc44" event={"ID":"fab1e12f-9f21-4e2b-a37d-5294a721a4f6","Type":"ContainerStarted","Data":"a62dd1be6b6c3a7fafba3962e368adee723d541bacb5cfabb473174797a51dd7"} Aug 04 09:40:23.023244 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.023219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" event={"ID":"8145c81afbc54966ebe426cd3860b587","Type":"ContainerStarted","Data":"a586b939aaa4ffc1cfb145d9e63516e241869038afb9f7fabbe609a24072128a"} Aug 04 09:40:23.024362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.024340 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerStarted","Data":"5f4d309aa1fe3a18babf5c8846740e779d2b827f9249b2e84490b94d348b50b2"} Aug 04 09:40:23.025315 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.025296 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jd726" event={"ID":"d13f5287-40a5-4a12-ae23-058ed3e504ee","Type":"ContainerStarted","Data":"8be64a79350293990f22eb514e2d29c13b34587c51938073099e2a541c21cb8d"} Aug 04 09:40:23.026519 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.026502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"52948f470254e69048926cf16afb1ac4947edf013ecb330e5901a9fcd760a8c4"} Aug 04 09:40:23.027507 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.027488 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" event={"ID":"42a2656b-b4de-4720-955d-ece4df1db68d","Type":"ContainerStarted","Data":"ead02ad36d9a650630eec502b16c86c498f128414310bbd8d8b3072287c10b9c"} Aug 04 09:40:23.028527 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.028506 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nmq98" event={"ID":"a7aadecf-401d-423a-a2c7-135c80d8be14","Type":"ContainerStarted","Data":"239a3773c8f88bb2c411b6a1fd27406f5125ea9468e017871efeb7b8c811e8a3"} Aug 04 09:40:23.029368 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.029352 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jj4kb" event={"ID":"730ebc68-1237-4215-8d3f-b098d50a944b","Type":"ContainerStarted","Data":"3ec3e0e5f84a921886895340b6f94069eb9de9b8721eecb7420811f7603ffab1"} Aug 04 09:40:23.550280 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.550050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:23.550458 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.550175 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:23.550458 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.550379 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:40:25.550360063 +0000 UTC m=+5.969586219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:23.650789 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.650758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:23.650907 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.650859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:23.650989 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.650973 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:23.651049 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.651039 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:25.651021417 +0000 UTC m=+6.070247576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:23.651456 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.651437 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:23.651527 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.651462 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:23.651527 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.651478 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:23.651527 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:23.651524 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:40:25.651509109 +0000 UTC m=+6.070735270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:23.965864 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.965718 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 09:35:21 +0000 UTC" deadline="2028-04-04 14:57:54.829126949 +0000 UTC" Aug 04 09:40:23.965864 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:23.965780 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14621h17m30.863350317s" Aug 04 09:40:24.014672 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:24.014618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:24.014824 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:24.014756 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:24.015168 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:24.015136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:24.015245 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:24.015225 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:24.015304 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:24.015285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:24.015394 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:24.015347 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:24.050119 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:24.050087 2558 generic.go:356] "Generic (PLEG): container finished" podID="b35fbf4a1c54155dd094f2a5f87502ea" containerID="dfc136aea0278550dc3534e4575604509a5aa235233b2c3af9d7866663f8f5fa" exitCode=0 Aug 04 09:40:24.050670 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:24.050629 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" event={"ID":"b35fbf4a1c54155dd094f2a5f87502ea","Type":"ContainerDied","Data":"dfc136aea0278550dc3534e4575604509a5aa235233b2c3af9d7866663f8f5fa"} Aug 04 09:40:24.069233 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:24.069185 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-46.ec2.internal" podStartSLOduration=3.06916583 podStartE2EDuration="3.06916583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:23.043975755 +0000 UTC m=+3.463201934" watchObservedRunningTime="2026-08-04 09:40:24.06916583 +0000 UTC m=+4.488392001" Aug 04 09:40:25.066856 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:25.066774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" event={"ID":"b35fbf4a1c54155dd094f2a5f87502ea","Type":"ContainerStarted","Data":"a282da0bb7b14bd218816d46d3d2a0fb7db9f37b19a8591ceef06f64597b0326"} Aug 04 09:40:25.571726 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:25.571139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:25.571726 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.571307 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:25.571726 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.571366 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:40:29.571349032 +0000 UTC m=+9.990575191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:25.672236 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:25.672203 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:25.672420 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:25.672252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:25.672420 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.672396 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:25.672420 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.672413 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:25.672632 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.672426 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:25.672632 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.672482 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:40:29.672463416 +0000 UTC m=+10.091689591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:25.672913 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.672892 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:25.673009 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:25.672952 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:29.672936024 +0000 UTC m=+10.092162202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:26.012294 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:26.012218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:26.012446 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:26.012359 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:26.012754 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:26.012731 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:26.012857 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:26.012833 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:26.012912 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:26.012877 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:26.012970 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:26.012940 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:28.012720 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:28.012614 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:28.012720 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:28.012648 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:28.012720 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:28.012712 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:28.013269 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:28.012801 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:28.013269 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:28.012935 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:28.013269 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:28.013158 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:29.603548 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:29.602961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:29.603548 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.603147 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:29.603548 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.603209 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:40:37.603190123 +0000 UTC m=+18.022416285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:29.703439 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:29.703340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:29.703454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.703502 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.703529 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.703544 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.703559 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.703625 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:40:37.703605352 +0000 UTC m=+18.122831515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:29.703711 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:29.703651 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:37.703637574 +0000 UTC m=+18.122863731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:30.015708 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:30.015635 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:30.015708 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:30.015666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:30.015708 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:30.015666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:30.015956 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:30.015759 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:30.015956 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:30.015851 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:30.016061 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:30.015979 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:32.012281 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:32.012233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:32.012281 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:32.012278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:32.012733 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:32.012233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:32.012733 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:32.012381 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:32.012733 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:32.012442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:32.012733 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:32.012512 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:34.012058 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:34.012025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:34.012464 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:34.012025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:34.012464 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:34.012141 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:34.012464 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:34.012220 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:34.012464 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:34.012038 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:34.012464 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:34.012296 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:36.011620 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:36.011587 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:36.012107 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:36.011587 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:36.012107 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:36.011723 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:36.012107 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:36.011599 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:36.012107 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:36.011794 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:36.012107 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:36.011883 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:37.660541 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:37.660505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:37.660938 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.660677 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:37.660938 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.660738 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:40:53.660724086 +0000 UTC m=+34.079950242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:37.761564 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:37.761534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:37.761733 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:37.761592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:37.761733 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.761692 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:37.761733 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.761709 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:37.761733 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.761728 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:37.761894 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.761741 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:37.761894 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.761765 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:53.761743325 +0000 UTC m=+34.180969482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:37.761894 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:37.761787 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:40:53.761775437 +0000 UTC m=+34.181001597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:38.012437 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:38.012358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:38.012616 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:38.012358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:38.012616 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:38.012492 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:38.012616 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:38.012366 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:38.012616 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:38.012587 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:38.012839 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:38.012691 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:40.012457 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:40.012428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:40.012907 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:40.012533 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:40.012907 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:40.012560 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:40.012907 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:40.012674 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:40.012907 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:40.012711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:40.012907 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:40.012802 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:42.012228 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.011916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:42.012999 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.011918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:42.012999 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.011917 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:42.012999 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:42.012307 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:42.012999 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:42.012383 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:42.012999 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:42.012442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:42.100027 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.099999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qvmtr" event={"ID":"c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8","Type":"ContainerStarted","Data":"9438b6912d4f9d77f55d4e6c8f96d413f21e3efa3b3b92f74b802ac241386d13"} Aug 04 09:40:42.101290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.101268 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmc44" event={"ID":"fab1e12f-9f21-4e2b-a37d-5294a721a4f6","Type":"ContainerStarted","Data":"ca56dd3464f68cd21b6e258188ba2d868776f81738c22bfffa825cf162ac3094"} Aug 04 09:40:42.105019 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.102889 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ae9f655-9221-43b6-af40-f66137cf3dd1" containerID="61f27e0002e7af7cd52c95e5a211fbdb89ba25913d011dfb628423d95cc2d577" exitCode=0 Aug 04 09:40:42.105019 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.103008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerDied","Data":"61f27e0002e7af7cd52c95e5a211fbdb89ba25913d011dfb628423d95cc2d577"} Aug 04 09:40:42.106865 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.106842 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jd726" event={"ID":"d13f5287-40a5-4a12-ae23-058ed3e504ee","Type":"ContainerStarted","Data":"2c8cbb518af52624d7d2f071cb0fd316a894c7e4e26c6e95c4523a11d09913fe"} Aug 04 09:40:42.109093 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.109075 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"96247307c8c8e9e9edeb9086da0b79127e26587b6124658ed49dad7625354307"} Aug 04 09:40:42.109181 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.109140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"0bed24e67b3573859f78d775fd4f2c1f60460757bfa51c46f083db9ee77b28d1"} Aug 04 09:40:42.109238 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.109190 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"ed14a748afd3fdc7cd79873969fc9710d1ab0714537a2f879e10b03c29feac2a"} Aug 04 09:40:42.109274 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.109247 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"ed3f522f55f50e1d36a04f88429171dc1529b45b44d45a0c87048763dd64f9d7"} Aug 04 09:40:42.110370 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.110351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" event={"ID":"42a2656b-b4de-4720-955d-ece4df1db68d","Type":"ContainerStarted","Data":"a115645d4558f1a06c0fc405a9ef597a9f3341c2f525a6fdcc6a94642302c974"} Aug 04 09:40:42.111671 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.111651 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nmq98" event={"ID":"a7aadecf-401d-423a-a2c7-135c80d8be14","Type":"ContainerStarted","Data":"ff501148753d27bd04f2eb5b81d2a6be7481bd3443bfaec30db0598f6878ceeb"} Aug 04 09:40:42.112896 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.112876 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" event={"ID":"86dfcd78-93ff-4f27-a6b9-228636c6ab8b","Type":"ContainerStarted","Data":"09c10cfdc819b65f32ead8e56de33e858ec7cc18cc9c557844667904beb99d94"} Aug 04 09:40:42.128037 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.128004 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-46.ec2.internal" podStartSLOduration=21.127993218 podStartE2EDuration="21.127993218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:25.085847281 +0000 UTC m=+5.505073461" watchObservedRunningTime="2026-08-04 09:40:42.127993218 +0000 UTC m=+22.547219396" Aug 04 09:40:42.181669 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.181626 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jd726" podStartSLOduration=3.479084012 podStartE2EDuration="22.181611286s" totalImagesPullingTime="18.702527274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:42.180969873 +0000 UTC m=+22.600196052" watchObservedRunningTime="2026-08-04 09:40:42.181611286 +0000 UTC m=+22.600837464" Aug 04 09:40:42.181897 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.181873 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qvmtr" podStartSLOduration=7.386120352 podStartE2EDuration="22.181863178s" totalImagesPullingTime="14.795742826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:42.128456032 +0000 UTC m=+22.547682211" watchObservedRunningTime="2026-08-04 09:40:42.181863178 +0000 UTC m=+22.601089364" Aug 04 09:40:42.294731 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.294651 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nmq98" podStartSLOduration=3.668944145 podStartE2EDuration="22.294636977s" totalImagesPullingTime="18.625692832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:42.214079999 +0000 UTC m=+22.633306177" watchObservedRunningTime="2026-08-04 09:40:42.294636977 +0000 UTC m=+22.713863207" Aug 04 09:40:42.334969 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:42.334927 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kmc44" podStartSLOduration=3.70113781 podStartE2EDuration="22.334912067s" totalImagesPullingTime="18.633774257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:42.294233154 +0000 UTC m=+22.713459333" watchObservedRunningTime="2026-08-04 09:40:42.334912067 +0000 UTC m=+22.754138246" Aug 04 09:40:43.115982 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:43.115906 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:43.118401 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:43.118368 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"76869301bfcd08a8b3025fc4b6c88c4870d7e2e2a80cecc5083d464bbc8b6115"} Aug 04 09:40:43.118513 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:43.118441 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"a114ecb736b0bc321a7bdad606028919211a0a49ea2f2986454823f2c031c7cf"} Aug 04 09:40:43.120161 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:43.120112 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jj4kb" event={"ID":"730ebc68-1237-4215-8d3f-b098d50a944b","Type":"ContainerStarted","Data":"417c31b4ff8e0b949073cfcf97b0b5c639610288d1a583a77a0498618a821ba9"} Aug 04 09:40:43.150803 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:43.150756 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fhnj7" podStartSLOduration=4.510805326 podStartE2EDuration="23.150742113s" totalImagesPullingTime="18.639936787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:42.376492551 +0000 UTC m=+22.795718733" watchObservedRunningTime="2026-08-04 09:40:43.150742113 +0000 UTC m=+23.569968292" Aug 04 09:40:43.271722 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:43.271686 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 04 09:40:44.004284 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.004164 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T09:40:43.271706635Z","UUID":"6d4d7fd5-0fe1-4fa8-a28f-f70f5d939964","Handler":null,"Name":"","Endpoint":""} Aug 04 09:40:44.005892 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.005851 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 04 09:40:44.006018 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.005909 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 04 09:40:44.011679 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.011650 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:44.012125 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.011815 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:44.012125 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:44.011861 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:44.012125 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:44.011950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:44.012125 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.012015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:44.012125 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:44.012091 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:44.124792 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.124755 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" event={"ID":"42a2656b-b4de-4720-955d-ece4df1db68d","Type":"ContainerStarted","Data":"1a9f6e3c4fa801ce3f0d7e81edf531c9b5eab7001536b5e84e84ba5c54f09d2d"} Aug 04 09:40:44.220377 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.220347 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:44.221093 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.221070 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:44.237800 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:44.237753 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jj4kb" podStartSLOduration=5.608116784 podStartE2EDuration="24.23773822s" totalImagesPullingTime="18.629621436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:43.151368524 +0000 UTC m=+23.570594703" watchObservedRunningTime="2026-08-04 09:40:44.23773822 +0000 UTC m=+24.656964417" Aug 04 09:40:45.130308 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:45.130161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"5ee22a43d852db60216ee2a94abf604d6877b4245ebfbdda375271660790713c"} Aug 04 09:40:45.132478 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:45.132430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" event={"ID":"42a2656b-b4de-4720-955d-ece4df1db68d","Type":"ContainerStarted","Data":"2aae2d1ab4c792217f2e3391270db5057fc77c54c37aa8f8c3ca458f881d49e6"} Aug 04 09:40:45.133184 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:45.133162 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qvmtr" Aug 04 09:40:45.158971 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:45.158934 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcnmm" podStartSLOduration=3.63024157 podStartE2EDuration="25.15892223s" totalImagesPullingTime="21.52868066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:45.158410894 +0000 UTC m=+25.577637095" watchObservedRunningTime="2026-08-04 09:40:45.15892223 +0000 UTC m=+25.578148448" Aug 04 09:40:46.012452 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:46.012423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:46.012452 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:46.012458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:46.012755 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:46.012426 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:46.012755 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:46.012547 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:46.012755 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:46.012650 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:46.012755 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:46.012727 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:47.139804 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:47.139734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" event={"ID":"fc3e50a3-efe5-4d1e-bf9c-7008d3fb0f72","Type":"ContainerStarted","Data":"923ffea51a0cd9fa8d78bf37cca96d100fa7a0a400434549bf8a8f9b404203c1"} Aug 04 09:40:47.140624 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:47.140000 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:47.141565 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:47.141544 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ae9f655-9221-43b6-af40-f66137cf3dd1" containerID="eab3bd5cf62d420c4f49f219e34d5ca34b909f1fd5c11fbea40047a3c2faacc3" exitCode=0 Aug 04 09:40:47.141665 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:47.141610 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerDied","Data":"eab3bd5cf62d420c4f49f219e34d5ca34b909f1fd5c11fbea40047a3c2faacc3"} Aug 04 09:40:47.155392 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:47.155373 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:47.264148 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:47.263987 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" podStartSLOduration=8.574378128 podStartE2EDuration="27.263972156s" totalImagesPullingTime="18.689594028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:47.189363323 +0000 UTC m=+27.608589502" watchObservedRunningTime="2026-08-04 09:40:47.263972156 +0000 UTC m=+27.683198335" Aug 04 09:40:48.012332 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:48.012311 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:48.012332 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:48.012321 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:48.012535 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:48.012403 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:48.012535 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:48.012471 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:48.012650 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:48.012600 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:48.012737 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:48.012685 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:48.145260 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:48.145225 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:48.145755 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:48.145398 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:48.163293 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:48.163269 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:40:49.148034 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.148000 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ae9f655-9221-43b6-af40-f66137cf3dd1" containerID="257c11bf28d4b444077b50ac31360e91648b9545425639317f8d1c805fb5f888" exitCode=0 Aug 04 09:40:49.148427 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.148083 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerDied","Data":"257c11bf28d4b444077b50ac31360e91648b9545425639317f8d1c805fb5f888"} Aug 04 09:40:49.149437 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.149415 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bqbtw"] Aug 04 09:40:49.149523 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.149495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:49.149613 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:49.149598 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:49.153924 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.153904 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lw6n5"] Aug 04 09:40:49.154002 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.153976 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:49.154058 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:49.154045 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:49.155927 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.155903 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kmwm4"] Aug 04 09:40:49.156032 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:49.155966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:49.156094 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:49.156030 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:51.012282 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:51.012244 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:51.012664 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:51.012343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:51.012664 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:51.012345 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:51.012664 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:51.012397 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:51.012664 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:51.012469 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:51.012664 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:51.012535 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:51.154479 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:51.154453 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ae9f655-9221-43b6-af40-f66137cf3dd1" containerID="e0f9883b63bb2247aee444a3b7ade5fb45faede38a9bfd7a606149eb9a1d3502" exitCode=0 Aug 04 09:40:51.154632 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:51.154493 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerDied","Data":"e0f9883b63bb2247aee444a3b7ade5fb45faede38a9bfd7a606149eb9a1d3502"} Aug 04 09:40:53.011926 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:53.011890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:53.011926 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:53.011926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:53.012351 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:53.011906 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:53.012351 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.012036 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:53.012351 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.012140 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:53.012351 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.012238 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:53.677299 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:53.677270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:53.677483 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.677423 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:53.677548 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.677493 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret podName:5605a405-1153-49fc-8cf9-34163351875a nodeName:}" failed. No retries permitted until 2026-08-04 09:41:25.677472538 +0000 UTC m=+66.096698699 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret") pod "global-pull-secret-syncer-bqbtw" (UID: "5605a405-1153-49fc-8cf9-34163351875a") : object "kube-system"/"original-pull-secret" not registered Aug 04 09:40:53.777816 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:53.777772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:53.777816 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:53.777813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:53.778052 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.777883 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:53.778052 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.777941 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:25.777926306 +0000 UTC m=+66.197152463 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 09:40:53.778052 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.777968 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 09:40:53.778052 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.777988 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 09:40:53.778052 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.778002 2558 projected.go:196] Error preparing data for projected volume kube-api-access-tvk8k for pod openshift-network-diagnostics/network-check-target-kmwm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:53.778052 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:53.778051 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k podName:657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b nodeName:}" failed. No retries permitted until 2026-08-04 09:41:25.778037044 +0000 UTC m=+66.197263217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvk8k" (UniqueName: "kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k") pod "network-check-target-kmwm4" (UID: "657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 09:40:55.012550 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.012373 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:55.013009 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.012376 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:55.013009 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.012659 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmwm4" podUID="657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b" Aug 04 09:40:55.013009 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.012385 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:55.013009 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.012751 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw6n5" podUID="5e5c4026-5523-47f3-a755-deffb7dd20a6" Aug 04 09:40:55.013009 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.012806 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bqbtw" podUID="5605a405-1153-49fc-8cf9-34163351875a" Aug 04 09:40:55.402463 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.402438 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-46.ec2.internal" event="NodeReady" Aug 04 09:40:55.402643 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.402589 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 04 09:40:55.447680 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.447655 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d48cd6f9b-ltqkj"] Aug 04 09:40:55.452334 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.452310 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.455463 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.455439 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 04 09:40:55.458401 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.458381 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 04 09:40:55.458869 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.458846 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b4dvw\"" Aug 04 09:40:55.459150 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.459104 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 04 09:40:55.464548 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.464521 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 04 09:40:55.466469 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.466449 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v84sd"] Aug 04 09:40:55.470784 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.470765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.474288 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.474201 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d48cd6f9b-ltqkj"] Aug 04 09:40:55.475096 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.475074 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wlqcr"] Aug 04 09:40:55.475197 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.475161 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 04 09:40:55.475316 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.475292 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 04 09:40:55.475386 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.475075 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rgp27\"" Aug 04 09:40:55.475386 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.475339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 04 09:40:55.478999 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.478978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.480527 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.480483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v84sd"] Aug 04 09:40:55.482615 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.482596 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 04 09:40:55.482757 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.482739 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 04 09:40:55.482853 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.482815 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-psh6m\"" Aug 04 09:40:55.494917 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.494897 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wlqcr"] Aug 04 09:40:55.589776 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-trusted-ca\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.589928 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589791 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-registry-certificates\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.589928 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.589928 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1435f33-0880-4af6-890d-c32368ab1978-config-volume\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.589928 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.589928 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc720d4-9c25-4614-b6fb-d68ee2319894-cert\") pod \"ingress-canary-v84sd\" (UID: \"efc720d4-9c25-4614-b6fb-d68ee2319894\") " pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-image-registry-private-configuration\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1435f33-0880-4af6-890d-c32368ab1978-tmp-dir\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-bound-sa-token\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.589982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8sc\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-kube-api-access-mc8sc\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.590007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm8m9\" (UniqueName: \"kubernetes.io/projected/efc720d4-9c25-4614-b6fb-d68ee2319894-kube-api-access-sm8m9\") pod \"ingress-canary-v84sd\" (UID: \"efc720d4-9c25-4614-b6fb-d68ee2319894\") " pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.590028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-installation-pull-secrets\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.590047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz6cs\" (UniqueName: \"kubernetes.io/projected/d1435f33-0880-4af6-890d-c32368ab1978-kube-api-access-rz6cs\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.590130 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.590072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e4763d2-12c5-433d-89d5-5df918aff016-ca-trust-extracted\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691116 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691116 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1435f33-0880-4af6-890d-c32368ab1978-config-volume\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.691116 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc720d4-9c25-4614-b6fb-d68ee2319894-cert\") pod \"ingress-canary-v84sd\" (UID: \"efc720d4-9c25-4614-b6fb-d68ee2319894\") " pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-image-registry-private-configuration\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1435f33-0880-4af6-890d-c32368ab1978-tmp-dir\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-bound-sa-token\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8sc\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-kube-api-access-mc8sc\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.691234 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8m9\" (UniqueName: \"kubernetes.io/projected/efc720d4-9c25-4614-b6fb-d68ee2319894-kube-api-access-sm8m9\") pod \"ingress-canary-v84sd\" (UID: \"efc720d4-9c25-4614-b6fb-d68ee2319894\") " pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-installation-pull-secrets\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6cs\" (UniqueName: \"kubernetes.io/projected/d1435f33-0880-4af6-890d-c32368ab1978-kube-api-access-rz6cs\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.691375 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.691327 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls podName:d1435f33-0880-4af6-890d-c32368ab1978 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:56.191304777 +0000 UTC m=+36.610530948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls") pod "dns-default-wlqcr" (UID: "d1435f33-0880-4af6-890d-c32368ab1978") : secret "dns-default-metrics-tls" not found Aug 04 09:40:55.691870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e4763d2-12c5-433d-89d5-5df918aff016-ca-trust-extracted\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-trusted-ca\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.691870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691774 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1435f33-0880-4af6-890d-c32368ab1978-config-volume\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.691870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.691850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-registry-certificates\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.692090 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.691236 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 09:40:55.692131 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.692095 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d48cd6f9b-ltqkj: secret "image-registry-tls" not found Aug 04 09:40:55.692165 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:55.692156 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls podName:9e4763d2-12c5-433d-89d5-5df918aff016 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:56.192139995 +0000 UTC m=+36.611366169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls") pod "image-registry-d48cd6f9b-ltqkj" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016") : secret "image-registry-tls" not found Aug 04 09:40:55.692377 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.692345 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-registry-certificates\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.692377 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.692363 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-trusted-ca\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.692558 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.692478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e4763d2-12c5-433d-89d5-5df918aff016-ca-trust-extracted\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.692629 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.692603 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1435f33-0880-4af6-890d-c32368ab1978-tmp-dir\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.695899 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.695879 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-installation-pull-secrets\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.695899 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.695888 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc720d4-9c25-4614-b6fb-d68ee2319894-cert\") pod \"ingress-canary-v84sd\" (UID: \"efc720d4-9c25-4614-b6fb-d68ee2319894\") " pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.696019 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.695880 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-image-registry-private-configuration\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.700814 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.700744 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6cs\" (UniqueName: \"kubernetes.io/projected/d1435f33-0880-4af6-890d-c32368ab1978-kube-api-access-rz6cs\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:55.702214 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.701982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8sc\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-kube-api-access-mc8sc\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.702683 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.702640 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm8m9\" (UniqueName: \"kubernetes.io/projected/efc720d4-9c25-4614-b6fb-d68ee2319894-kube-api-access-sm8m9\") pod \"ingress-canary-v84sd\" (UID: \"efc720d4-9c25-4614-b6fb-d68ee2319894\") " pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:55.703193 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.703172 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-bound-sa-token\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:55.781214 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:55.781190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v84sd" Aug 04 09:40:56.195673 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:56.195641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:56.196301 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:56.195683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:56.196301 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:56.195809 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 09:40:56.196301 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:56.195866 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls podName:d1435f33-0880-4af6-890d-c32368ab1978 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:57.195847684 +0000 UTC m=+37.615073843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls") pod "dns-default-wlqcr" (UID: "d1435f33-0880-4af6-890d-c32368ab1978") : secret "dns-default-metrics-tls" not found Aug 04 09:40:56.196301 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:56.195809 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 09:40:56.196301 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:56.195899 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d48cd6f9b-ltqkj: secret "image-registry-tls" not found Aug 04 09:40:56.196301 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:56.195955 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls podName:9e4763d2-12c5-433d-89d5-5df918aff016 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:57.195938216 +0000 UTC m=+37.615164373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls") pod "image-registry-d48cd6f9b-ltqkj" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016") : secret "image-registry-tls" not found Aug 04 09:40:56.276822 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:56.276786 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v84sd"] Aug 04 09:40:56.279494 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:40:56.279464 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc720d4_9c25_4614_b6fb_d68ee2319894.slice/crio-dd414c489dc5647e39bf2e5a2c4168446093b814fea7dbb66897bb586053d3fa WatchSource:0}: Error finding container dd414c489dc5647e39bf2e5a2c4168446093b814fea7dbb66897bb586053d3fa: Status 404 returned error can't find the container with id dd414c489dc5647e39bf2e5a2c4168446093b814fea7dbb66897bb586053d3fa Aug 04 09:40:57.011863 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.011823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:40:57.012033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.011823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:40:57.012033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.011823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:40:57.016109 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.016085 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 09:40:57.016109 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.016103 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpz8l\"" Aug 04 09:40:57.016109 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.016085 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 09:40:57.016329 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.016086 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfsnh\"" Aug 04 09:40:57.016329 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.016093 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 09:40:57.016428 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.016416 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 09:40:57.173753 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.173720 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ae9f655-9221-43b6-af40-f66137cf3dd1" containerID="5a4b39b95a30e9d02e144ae18f4c3f9af159bd948364a93b7c2d8a3b4d4147e8" exitCode=0 Aug 04 09:40:57.173934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.173797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerDied","Data":"5a4b39b95a30e9d02e144ae18f4c3f9af159bd948364a93b7c2d8a3b4d4147e8"} Aug 04 09:40:57.175073 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.175051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v84sd" event={"ID":"efc720d4-9c25-4614-b6fb-d68ee2319894","Type":"ContainerStarted","Data":"dd414c489dc5647e39bf2e5a2c4168446093b814fea7dbb66897bb586053d3fa"} Aug 04 09:40:57.204711 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.204688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:57.205108 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:57.204724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:57.205108 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:57.204816 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 09:40:57.205108 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:57.204834 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d48cd6f9b-ltqkj: secret "image-registry-tls" not found Aug 04 09:40:57.205108 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:57.204850 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 09:40:57.205108 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:57.204884 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls podName:9e4763d2-12c5-433d-89d5-5df918aff016 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:59.204868015 +0000 UTC m=+39.624094172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls") pod "image-registry-d48cd6f9b-ltqkj" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016") : secret "image-registry-tls" not found Aug 04 09:40:57.205108 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:57.204910 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls podName:d1435f33-0880-4af6-890d-c32368ab1978 nodeName:}" failed. No retries permitted until 2026-08-04 09:40:59.204895143 +0000 UTC m=+39.624121316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls") pod "dns-default-wlqcr" (UID: "d1435f33-0880-4af6-890d-c32368ab1978") : secret "dns-default-metrics-tls" not found Aug 04 09:40:58.181073 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:58.181042 2558 generic.go:356] "Generic (PLEG): container finished" podID="2ae9f655-9221-43b6-af40-f66137cf3dd1" containerID="df4c1f5bf24a7a6fbc37c074e3731bb53040b0a52307a2d8e55f37b3f84f5f43" exitCode=0 Aug 04 09:40:58.181242 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:58.181108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerDied","Data":"df4c1f5bf24a7a6fbc37c074e3731bb53040b0a52307a2d8e55f37b3f84f5f43"} Aug 04 09:40:59.186834 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:59.186805 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5884" event={"ID":"2ae9f655-9221-43b6-af40-f66137cf3dd1","Type":"ContainerStarted","Data":"1b00769a6c39f6cff28d5178b2b902657940c4eb7d0f0f6898b2aa0d79f4197e"} Aug 04 09:40:59.217203 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:59.217164 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s5884" podStartSLOduration=7.935827373 podStartE2EDuration="39.217149493s" totalImagesPullingTime="31.28132212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:40:59.215851605 +0000 UTC m=+39.635077785" watchObservedRunningTime="2026-08-04 09:40:59.217149493 +0000 UTC m=+39.636375671" Aug 04 09:40:59.221348 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:59.221326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:40:59.221432 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:40:59.221354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:40:59.221469 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:59.221459 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 09:40:59.221503 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:59.221467 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 09:40:59.221503 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:59.221483 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d48cd6f9b-ltqkj: secret "image-registry-tls" not found Aug 04 09:40:59.221503 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:59.221500 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls podName:d1435f33-0880-4af6-890d-c32368ab1978 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:03.221489522 +0000 UTC m=+43.640715680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls") pod "dns-default-wlqcr" (UID: "d1435f33-0880-4af6-890d-c32368ab1978") : secret "dns-default-metrics-tls" not found Aug 04 09:40:59.221614 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:40:59.221522 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls podName:9e4763d2-12c5-433d-89d5-5df918aff016 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:03.22151061 +0000 UTC m=+43.640736768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls") pod "image-registry-d48cd6f9b-ltqkj" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016") : secret "image-registry-tls" not found Aug 04 09:41:00.190685 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:00.190607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v84sd" event={"ID":"efc720d4-9c25-4614-b6fb-d68ee2319894","Type":"ContainerStarted","Data":"ed9ef896b36b1af909ed68aaf6e0b21ddc080641400f20f9edf7e15454793795"} Aug 04 09:41:00.209832 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:00.209788 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v84sd" podStartSLOduration=2.2978673499999998 podStartE2EDuration="5.209772654s" totalImagesPullingTime="2.911905304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:00.209162298 +0000 UTC m=+40.628388478" watchObservedRunningTime="2026-08-04 09:41:00.209772654 +0000 UTC m=+40.628998825" Aug 04 09:41:03.246977 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:03.246946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:03.247323 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:03.246985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:03.247323 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:03.247118 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 09:41:03.247323 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:03.247171 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls podName:d1435f33-0880-4af6-890d-c32368ab1978 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:11.247158697 +0000 UTC m=+51.666384854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls") pod "dns-default-wlqcr" (UID: "d1435f33-0880-4af6-890d-c32368ab1978") : secret "dns-default-metrics-tls" not found Aug 04 09:41:03.247323 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:03.247118 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 09:41:03.247323 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:03.247212 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d48cd6f9b-ltqkj: secret "image-registry-tls" not found Aug 04 09:41:03.247323 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:03.247255 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls podName:9e4763d2-12c5-433d-89d5-5df918aff016 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:11.247243718 +0000 UTC m=+51.666469888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls") pod "image-registry-d48cd6f9b-ltqkj" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016") : secret "image-registry-tls" not found Aug 04 09:41:07.472265 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.472231 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv"] Aug 04 09:41:07.514354 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.514329 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv"] Aug 04 09:41:07.514474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.514413 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.517423 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.517396 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 04 09:41:07.517532 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.517454 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 04 09:41:07.517532 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.517470 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 04 09:41:07.520160 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.520139 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 04 09:41:07.525861 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.525846 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bjtb2\"" Aug 04 09:41:07.674302 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.674272 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eec54f08-22f1-4427-92fc-318ee7081966-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.674432 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.674339 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.674432 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.674378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2x2m\" (UniqueName: \"kubernetes.io/projected/eec54f08-22f1-4427-92fc-318ee7081966-kube-api-access-x2x2m\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.774811 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.774741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eec54f08-22f1-4427-92fc-318ee7081966-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.774944 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.774835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.774944 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.774887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2x2m\" (UniqueName: \"kubernetes.io/projected/eec54f08-22f1-4427-92fc-318ee7081966-kube-api-access-x2x2m\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.775054 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:07.774974 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:07.775054 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:07.775034 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls podName:eec54f08-22f1-4427-92fc-318ee7081966 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:08.275019713 +0000 UTC m=+48.694245873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqtlv" (UID: "eec54f08-22f1-4427-92fc-318ee7081966") : secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:07.775449 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.775429 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eec54f08-22f1-4427-92fc-318ee7081966-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:07.795660 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:07.795397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2x2m\" (UniqueName: \"kubernetes.io/projected/eec54f08-22f1-4427-92fc-318ee7081966-kube-api-access-x2x2m\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:08.279518 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:08.279489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:08.279702 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:08.279646 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:08.279773 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:08.279731 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls podName:eec54f08-22f1-4427-92fc-318ee7081966 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:09.279710595 +0000 UTC m=+49.698936752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqtlv" (UID: "eec54f08-22f1-4427-92fc-318ee7081966") : secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:09.287053 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:09.287020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:09.287409 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:09.287153 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:09.287409 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:09.287216 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls podName:eec54f08-22f1-4427-92fc-318ee7081966 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:11.287199703 +0000 UTC m=+51.706425863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqtlv" (UID: "eec54f08-22f1-4427-92fc-318ee7081966") : secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:10.370311 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.370283 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm"] Aug 04 09:41:10.378238 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.378223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.381503 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.381485 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Aug 04 09:41:10.381667 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.381646 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Aug 04 09:41:10.381715 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.381700 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Aug 04 09:41:10.382773 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.382755 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Aug 04 09:41:10.382864 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.382755 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wt5rb\"" Aug 04 09:41:10.386884 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.386865 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm"] Aug 04 09:41:10.495900 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.495869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4l6\" (UniqueName: \"kubernetes.io/projected/c5874556-2dc2-46ac-a799-a08b80fd43c1-kube-api-access-jg4l6\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.496010 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.495911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5874556-2dc2-46ac-a799-a08b80fd43c1-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.496010 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.495938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5874556-2dc2-46ac-a799-a08b80fd43c1-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.596784 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.596751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4l6\" (UniqueName: \"kubernetes.io/projected/c5874556-2dc2-46ac-a799-a08b80fd43c1-kube-api-access-jg4l6\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.596924 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.596794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5874556-2dc2-46ac-a799-a08b80fd43c1-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.596924 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.596818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5874556-2dc2-46ac-a799-a08b80fd43c1-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.597372 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.597342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5874556-2dc2-46ac-a799-a08b80fd43c1-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.598964 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.598940 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5874556-2dc2-46ac-a799-a08b80fd43c1-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.607431 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.606920 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4l6\" (UniqueName: \"kubernetes.io/projected/c5874556-2dc2-46ac-a799-a08b80fd43c1-kube-api-access-jg4l6\") pod \"kube-storage-version-migrator-operator-7878f4b88c-8mldm\" (UID: \"c5874556-2dc2-46ac-a799-a08b80fd43c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.687666 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.687639 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" Aug 04 09:41:10.816770 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:10.816740 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm"] Aug 04 09:41:10.819770 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:10.819741 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5874556_2dc2_46ac_a799_a08b80fd43c1.slice/crio-e35503693f14e2d6bc6ee8e88461394396e826ceb578f79793c6c99f9c60ab92 WatchSource:0}: Error finding container e35503693f14e2d6bc6ee8e88461394396e826ceb578f79793c6c99f9c60ab92: Status 404 returned error can't find the container with id e35503693f14e2d6bc6ee8e88461394396e826ceb578f79793c6c99f9c60ab92 Aug 04 09:41:11.214439 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:11.214405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" event={"ID":"c5874556-2dc2-46ac-a799-a08b80fd43c1","Type":"ContainerStarted","Data":"e35503693f14e2d6bc6ee8e88461394396e826ceb578f79793c6c99f9c60ab92"} Aug 04 09:41:11.302366 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:11.302344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:11.302477 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:11.302374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:11.302477 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:11.302441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:11.302570 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302487 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 09:41:11.302570 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302506 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d48cd6f9b-ltqkj: secret "image-registry-tls" not found Aug 04 09:41:11.302570 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302520 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:11.302570 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302538 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 09:41:11.302570 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302563 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls podName:9e4763d2-12c5-433d-89d5-5df918aff016 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:27.302541614 +0000 UTC m=+67.721767773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls") pod "image-registry-d48cd6f9b-ltqkj" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016") : secret "image-registry-tls" not found Aug 04 09:41:11.302754 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302597 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls podName:eec54f08-22f1-4427-92fc-318ee7081966 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:15.302571747 +0000 UTC m=+55.721797903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqtlv" (UID: "eec54f08-22f1-4427-92fc-318ee7081966") : secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:11.302754 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:11.302612 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls podName:d1435f33-0880-4af6-890d-c32368ab1978 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:27.302606764 +0000 UTC m=+67.721832920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls") pod "dns-default-wlqcr" (UID: "d1435f33-0880-4af6-890d-c32368ab1978") : secret "dns-default-metrics-tls" not found Aug 04 09:41:13.273492 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.273465 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l45b4"] Aug 04 09:41:13.294365 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.294343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.301738 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.301720 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 04 09:41:13.301833 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.301778 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 04 09:41:13.301986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.301971 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54lnd\"" Aug 04 09:41:13.302071 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.302055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 04 09:41:13.302113 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.302057 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 04 09:41:13.309026 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.309006 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l45b4"] Aug 04 09:41:13.315240 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.315220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjg79\" (UniqueName: \"kubernetes.io/projected/788245c9-17a6-4535-8467-f075b920e37c-kube-api-access-cjg79\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.315327 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.315250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/788245c9-17a6-4535-8467-f075b920e37c-data-volume\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.315327 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.315268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.315423 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.315340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.315490 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.315468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/788245c9-17a6-4535-8467-f075b920e37c-crio-socket\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.416529 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/788245c9-17a6-4535-8467-f075b920e37c-crio-socket\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.416698 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416537 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjg79\" (UniqueName: \"kubernetes.io/projected/788245c9-17a6-4535-8467-f075b920e37c-kube-api-access-cjg79\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.416698 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416559 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/788245c9-17a6-4535-8467-f075b920e37c-data-volume\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.416698 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.416698 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416638 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/788245c9-17a6-4535-8467-f075b920e37c-crio-socket\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.416698 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.416687 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 09:41:13.417000 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.417000 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.416740 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:13.916722936 +0000 UTC m=+54.335949094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : secret "insights-runtime-extractor-tls" not found Aug 04 09:41:13.417000 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.416808 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 09:41:13.417000 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.416879 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:13.916862085 +0000 UTC m=+54.336088255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : configmap "kube-rbac-proxy" not found Aug 04 09:41:13.417000 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.416891 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/788245c9-17a6-4535-8467-f075b920e37c-data-volume\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.436865 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.436840 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjg79\" (UniqueName: \"kubernetes.io/projected/788245c9-17a6-4535-8467-f075b920e37c-kube-api-access-cjg79\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.919768 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.919736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.919935 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:13.919789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:13.919935 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.919900 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 09:41:13.920008 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.919963 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:14.919948314 +0000 UTC m=+55.339174471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : secret "insights-runtime-extractor-tls" not found Aug 04 09:41:13.920008 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.919906 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 09:41:13.920091 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:13.920026 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:14.92001485 +0000 UTC m=+55.339241007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : configmap "kube-rbac-proxy" not found Aug 04 09:41:14.224325 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.224246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" event={"ID":"c5874556-2dc2-46ac-a799-a08b80fd43c1","Type":"ContainerStarted","Data":"a950b9c403bac914d2d05e6812f4be306386bab67d54b224da034c9bc222fa74"} Aug 04 09:41:14.242828 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.242782 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" podStartSLOduration=1.8090135539999999 podStartE2EDuration="4.242768248s" totalImagesPullingTime="2.433754694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:14.241617825 +0000 UTC m=+54.660844004" watchObservedRunningTime="2026-08-04 09:41:14.242768248 +0000 UTC m=+54.661994427" Aug 04 09:41:14.552150 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.551213 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq"] Aug 04 09:41:14.554739 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.554717 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" Aug 04 09:41:14.557514 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.557482 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-46.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-46.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Aug 04 09:41:14.557648 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.557539 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-46.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-46.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Aug 04 09:41:14.557648 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.557618 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-sa-dockercfg-j2vpv\" is forbidden: User \"system:node:ip-10-0-135-46.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-46.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j2vpv\"" type="*v1.Secret" Aug 04 09:41:14.557771 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.557648 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"migrator-68bc745d87-zffmq\" is forbidden: User \"system:node:ip-10-0-135-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-46.ec2.internal' and this object" podUID="0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" Aug 04 09:41:14.565276 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.565253 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq"] Aug 04 09:41:14.625046 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.625019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9wg8\" (UniqueName: \"kubernetes.io/projected/0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb-kube-api-access-b9wg8\") pod \"migrator-68bc745d87-zffmq\" (UID: \"0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" Aug 04 09:41:14.726163 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.726139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wg8\" (UniqueName: \"kubernetes.io/projected/0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb-kube-api-access-b9wg8\") pod \"migrator-68bc745d87-zffmq\" (UID: \"0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" Aug 04 09:41:14.928247 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.928221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:14.928378 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.928278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:14.928423 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.928380 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 09:41:14.928457 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.928421 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 09:41:14.928457 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.928443 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:16.928427357 +0000 UTC m=+57.347653529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : secret "insights-runtime-extractor-tls" not found Aug 04 09:41:14.928553 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:14.928472 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:16.92845908 +0000 UTC m=+57.347685238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : configmap "kube-rbac-proxy" not found Aug 04 09:41:14.969031 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:14.969011 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nmq98_a7aadecf-401d-423a-a2c7-135c80d8be14/dns-node-resolver/0.log" Aug 04 09:41:15.331999 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:15.331925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:15.332118 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:15.332067 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:15.332157 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:15.332129 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls podName:eec54f08-22f1-4427-92fc-318ee7081966 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:23.332112017 +0000 UTC m=+63.751338184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqtlv" (UID: "eec54f08-22f1-4427-92fc-318ee7081966") : secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:15.730606 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:15.730562 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 04 09:41:15.969805 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:15.969782 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmc44_fab1e12f-9f21-4e2b-a37d-5294a721a4f6/node-ca/0.log" Aug 04 09:41:15.998086 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:15.998035 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 04 09:41:16.006572 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.006542 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9wg8\" (UniqueName: \"kubernetes.io/projected/0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb-kube-api-access-b9wg8\") pod \"migrator-68bc745d87-zffmq\" (UID: \"0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" Aug 04 09:41:16.021476 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.021459 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j2vpv\"" Aug 04 09:41:16.062980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.062956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" Aug 04 09:41:16.175740 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.175716 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq"] Aug 04 09:41:16.177992 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:16.177959 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3b968b_0250_4b48_a2b9_b8ab4e2e1ddb.slice/crio-5b332ca19d9a08a1760507bcc7b236dc27b229bd19d2385d22dd4650ff9072b8 WatchSource:0}: Error finding container 5b332ca19d9a08a1760507bcc7b236dc27b229bd19d2385d22dd4650ff9072b8: Status 404 returned error can't find the container with id 5b332ca19d9a08a1760507bcc7b236dc27b229bd19d2385d22dd4650ff9072b8 Aug 04 09:41:16.229980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.229957 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" event={"ID":"0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb","Type":"ContainerStarted","Data":"5b332ca19d9a08a1760507bcc7b236dc27b229bd19d2385d22dd4650ff9072b8"} Aug 04 09:41:16.772750 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.772725 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v84sd_efc720d4-9c25-4614-b6fb-d68ee2319894/serve-healthcheck-canary/0.log" Aug 04 09:41:16.945541 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.945513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:16.945717 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:16.945563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:16.945717 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:16.945671 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 09:41:16.945717 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:16.945688 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 09:41:16.945872 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:16.945742 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:20.94572789 +0000 UTC m=+61.364954048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : configmap "kube-rbac-proxy" not found Aug 04 09:41:16.945872 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:16.945758 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:20.945749805 +0000 UTC m=+61.364975966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : secret "insights-runtime-extractor-tls" not found Aug 04 09:41:18.236847 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:18.236815 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" event={"ID":"0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb","Type":"ContainerStarted","Data":"96415f517a1337934daa1168a2b3c0bd5161fcff9af4f8626c5f015637ecdd69"} Aug 04 09:41:18.237263 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:18.236863 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" event={"ID":"0d3b968b-0250-4b48-a2b9-b8ab4e2e1ddb","Type":"ContainerStarted","Data":"bc0676a2722062a09242c3f13fea39bece7a5b8426cbd477fd8ce790b28225dc"} Aug 04 09:41:18.256020 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:18.255978 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-zffmq" podStartSLOduration=3.133211469 podStartE2EDuration="4.255965226s" totalImagesPullingTime="1.122753757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:18.255392154 +0000 UTC m=+58.674618330" watchObservedRunningTime="2026-08-04 09:41:18.255965226 +0000 UTC m=+58.675191405" Aug 04 09:41:20.165425 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:20.165403 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btz6g" Aug 04 09:41:20.974817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:20.974783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:20.974997 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:20.974837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:20.974997 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:20.974905 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 09:41:20.974997 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:20.974948 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 09:41:20.974997 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:20.974955 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:28.974941341 +0000 UTC m=+69.394167498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : configmap "kube-rbac-proxy" not found Aug 04 09:41:20.975164 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:20.975020 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:28.975001682 +0000 UTC m=+69.394227839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : secret "insights-runtime-extractor-tls" not found Aug 04 09:41:23.393366 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:23.393332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:23.393770 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:23.393475 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:23.393770 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:23.393539 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls podName:eec54f08-22f1-4427-92fc-318ee7081966 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:39.393523046 +0000 UTC m=+79.812749208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-mqtlv" (UID: "eec54f08-22f1-4427-92fc-318ee7081966") : secret "cluster-monitoring-operator-tls" not found Aug 04 09:41:25.710641 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.710603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:41:25.713973 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.713955 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 09:41:25.723588 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.723563 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5605a405-1153-49fc-8cf9-34163351875a-original-pull-secret\") pod \"global-pull-secret-syncer-bqbtw\" (UID: \"5605a405-1153-49fc-8cf9-34163351875a\") " pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:41:25.811145 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.811122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:41:25.811236 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.811158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:41:25.814193 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.814177 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 09:41:25.814315 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.814298 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 09:41:25.821622 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:25.821597 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 04 09:41:25.821622 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.821620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bqbtw" Aug 04 09:41:25.821755 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:25.821678 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs podName:5e5c4026-5523-47f3-a755-deffb7dd20a6 nodeName:}" failed. No retries permitted until 2026-08-04 09:42:29.821659581 +0000 UTC m=+130.240885742 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs") pod "network-metrics-daemon-lw6n5" (UID: "5e5c4026-5523-47f3-a755-deffb7dd20a6") : secret "metrics-daemon-secret" not found Aug 04 09:41:25.824490 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.824408 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 09:41:25.834276 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.834248 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvk8k\" (UniqueName: \"kubernetes.io/projected/657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b-kube-api-access-tvk8k\") pod \"network-check-target-kmwm4\" (UID: \"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b\") " pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:41:25.942465 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:25.942441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bqbtw"] Aug 04 09:41:25.944833 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:25.944806 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5605a405_1153_49fc_8cf9_34163351875a.slice/crio-d9c4c3c02f79978d412798dade25775bb282efd537c5decddb6a4d17c3b72d78 WatchSource:0}: Error finding container d9c4c3c02f79978d412798dade25775bb282efd537c5decddb6a4d17c3b72d78: Status 404 returned error can't find the container with id d9c4c3c02f79978d412798dade25775bb282efd537c5decddb6a4d17c3b72d78 Aug 04 09:41:26.134236 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:26.134184 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfsnh\"" Aug 04 09:41:26.142311 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:26.142294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:41:26.256517 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:26.256488 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bqbtw" event={"ID":"5605a405-1153-49fc-8cf9-34163351875a","Type":"ContainerStarted","Data":"d9c4c3c02f79978d412798dade25775bb282efd537c5decddb6a4d17c3b72d78"} Aug 04 09:41:26.262686 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:26.262661 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kmwm4"] Aug 04 09:41:26.266497 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:26.266475 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657d3ec2_3dcb_4ab0_8bb2_f56bb1c1d00b.slice/crio-39fb7e9c21fe6160ea3f1e47a158e982786473eb8bb332beac5bc724588495e2 WatchSource:0}: Error finding container 39fb7e9c21fe6160ea3f1e47a158e982786473eb8bb332beac5bc724588495e2: Status 404 returned error can't find the container with id 39fb7e9c21fe6160ea3f1e47a158e982786473eb8bb332beac5bc724588495e2 Aug 04 09:41:27.261245 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.261174 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kmwm4" event={"ID":"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b","Type":"ContainerStarted","Data":"39fb7e9c21fe6160ea3f1e47a158e982786473eb8bb332beac5bc724588495e2"} Aug 04 09:41:27.324386 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.324292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:27.324386 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.324335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:27.327250 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.327215 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1435f33-0880-4af6-890d-c32368ab1978-metrics-tls\") pod \"dns-default-wlqcr\" (UID: \"d1435f33-0880-4af6-890d-c32368ab1978\") " pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:27.327840 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.327819 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"image-registry-d48cd6f9b-ltqkj\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:27.568307 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.568216 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b4dvw\"" Aug 04 09:41:27.575319 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.575282 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:27.594134 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.594108 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-psh6m\"" Aug 04 09:41:27.601056 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.600884 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:27.767071 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.767046 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d48cd6f9b-ltqkj"] Aug 04 09:41:27.769262 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:27.769236 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4763d2_12c5_433d_89d5_5df918aff016.slice/crio-648ddafabc65d2a02d96237eeadf9e84b2624ff8c2af2d7e8aaa0e9170c2df86 WatchSource:0}: Error finding container 648ddafabc65d2a02d96237eeadf9e84b2624ff8c2af2d7e8aaa0e9170c2df86: Status 404 returned error can't find the container with id 648ddafabc65d2a02d96237eeadf9e84b2624ff8c2af2d7e8aaa0e9170c2df86 Aug 04 09:41:27.789782 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:27.789728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wlqcr"] Aug 04 09:41:27.793449 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:27.793414 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1435f33_0880_4af6_890d_c32368ab1978.slice/crio-fb064e74955fa3d2e775140c2ffd4de6fc5afadf996149642335466349235541 WatchSource:0}: Error finding container fb064e74955fa3d2e775140c2ffd4de6fc5afadf996149642335466349235541: Status 404 returned error can't find the container with id fb064e74955fa3d2e775140c2ffd4de6fc5afadf996149642335466349235541 Aug 04 09:41:28.267217 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:28.267171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wlqcr" event={"ID":"d1435f33-0880-4af6-890d-c32368ab1978","Type":"ContainerStarted","Data":"fb064e74955fa3d2e775140c2ffd4de6fc5afadf996149642335466349235541"} Aug 04 09:41:28.270495 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:28.269620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" event={"ID":"9e4763d2-12c5-433d-89d5-5df918aff016","Type":"ContainerStarted","Data":"ee1de7e45bf1d327f646020115e5584d2a61e11eb38029956fea557f926c890f"} Aug 04 09:41:28.270495 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:28.269678 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" event={"ID":"9e4763d2-12c5-433d-89d5-5df918aff016","Type":"ContainerStarted","Data":"648ddafabc65d2a02d96237eeadf9e84b2624ff8c2af2d7e8aaa0e9170c2df86"} Aug 04 09:41:28.270495 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:28.270453 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:28.299547 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:28.299500 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" podStartSLOduration=68.29948298 podStartE2EDuration="1m8.29948298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:28.299337992 +0000 UTC m=+68.718564172" watchObservedRunningTime="2026-08-04 09:41:28.29948298 +0000 UTC m=+68.718709162" Aug 04 09:41:29.040038 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:29.039998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:29.040272 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:29.040065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:29.040272 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:29.040176 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 09:41:29.040272 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:29.040261 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls podName:788245c9-17a6-4535-8467-f075b920e37c nodeName:}" failed. No retries permitted until 2026-08-04 09:41:45.040238901 +0000 UTC m=+85.459465060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l45b4" (UID: "788245c9-17a6-4535-8467-f075b920e37c") : secret "insights-runtime-extractor-tls" not found Aug 04 09:41:29.040786 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:29.040737 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/788245c9-17a6-4535-8467-f075b920e37c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:32.283589 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.283537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bqbtw" event={"ID":"5605a405-1153-49fc-8cf9-34163351875a","Type":"ContainerStarted","Data":"0f456387207885079c499677f5951cab9e71886c6dffb8c17bf85bc5711c3cf4"} Aug 04 09:41:32.284905 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.284880 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kmwm4" event={"ID":"657d3ec2-3dcb-4ab0-8bb2-f56bb1c1d00b","Type":"ContainerStarted","Data":"e7c5970796c55640907756cce30e904dafefca8f89b8e130935851fa96c3909f"} Aug 04 09:41:32.285018 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.284935 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:41:32.286325 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.286303 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wlqcr" event={"ID":"d1435f33-0880-4af6-890d-c32368ab1978","Type":"ContainerStarted","Data":"ff2cd3f9d9ef04e383d430e41f44ef0afb03bfc813a4aab8803f542e099876d7"} Aug 04 09:41:32.286429 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.286343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wlqcr" event={"ID":"d1435f33-0880-4af6-890d-c32368ab1978","Type":"ContainerStarted","Data":"16d2e07b599101989a566df2da9a78a7d7e8b52a5703c3370ae8a095c0fccc92"} Aug 04 09:41:32.286468 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.286443 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:32.304463 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.304425 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bqbtw" podStartSLOduration=66.880525467 podStartE2EDuration="1m12.304414184s" totalImagesPullingTime="5.423888717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:32.302855152 +0000 UTC m=+72.722081334" watchObservedRunningTime="2026-08-04 09:41:32.304414184 +0000 UTC m=+72.723640362" Aug 04 09:41:32.326145 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.326107 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wlqcr" podStartSLOduration=33.749426108 podStartE2EDuration="37.326095215s" totalImagesPullingTime="3.576669107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:32.324921746 +0000 UTC m=+72.744147925" watchObservedRunningTime="2026-08-04 09:41:32.326095215 +0000 UTC m=+72.745321394" Aug 04 09:41:32.344772 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:32.344737 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kmwm4" podStartSLOduration=67.26398843 podStartE2EDuration="1m12.344724249s" totalImagesPullingTime="5.080735819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:32.344169014 +0000 UTC m=+72.763395192" watchObservedRunningTime="2026-08-04 09:41:32.344724249 +0000 UTC m=+72.763950427" Aug 04 09:41:39.411037 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:39.411001 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:39.413230 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:39.413208 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eec54f08-22f1-4427-92fc-318ee7081966-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-mqtlv\" (UID: \"eec54f08-22f1-4427-92fc-318ee7081966\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:39.625735 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:39.625705 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bjtb2\"" Aug 04 09:41:39.633235 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:39.633215 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" Aug 04 09:41:39.759765 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:39.759729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv"] Aug 04 09:41:39.762006 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:39.761981 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec54f08_22f1_4427_92fc_318ee7081966.slice/crio-1dcba6afbe68c23d79ffa78fa2dadfcd7502889df670b8005d2adcd14883fa29 WatchSource:0}: Error finding container 1dcba6afbe68c23d79ffa78fa2dadfcd7502889df670b8005d2adcd14883fa29: Status 404 returned error can't find the container with id 1dcba6afbe68c23d79ffa78fa2dadfcd7502889df670b8005d2adcd14883fa29 Aug 04 09:41:40.311210 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:40.311174 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" event={"ID":"eec54f08-22f1-4427-92fc-318ee7081966","Type":"ContainerStarted","Data":"1dcba6afbe68c23d79ffa78fa2dadfcd7502889df670b8005d2adcd14883fa29"} Aug 04 09:41:42.291970 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:42.291942 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wlqcr" Aug 04 09:41:42.319761 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:42.319731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" event={"ID":"eec54f08-22f1-4427-92fc-318ee7081966","Type":"ContainerStarted","Data":"86b5bcdbd8ba3cbb813c9bee02b1a125c9230afdcabba193cf20144e725aa8e3"} Aug 04 09:41:42.341892 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:42.341852 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-mqtlv" podStartSLOduration=33.422688619 podStartE2EDuration="35.341837994s" totalImagesPullingTime="1.919149375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:42.340532457 +0000 UTC m=+82.759758636" watchObservedRunningTime="2026-08-04 09:41:42.341837994 +0000 UTC m=+82.761064173" Aug 04 09:41:43.114318 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.114288 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr"] Aug 04 09:41:43.117464 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.117445 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.129048 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.129025 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Aug 04 09:41:43.129139 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.129025 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Aug 04 09:41:43.129870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.129848 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Aug 04 09:41:43.129980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.129879 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Aug 04 09:41:43.129980 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.129953 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Aug 04 09:41:43.130105 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.129996 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Aug 04 09:41:43.131819 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.131807 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Aug 04 09:41:43.133610 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.133568 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr"] Aug 04 09:41:43.238244 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.238214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-ca\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.238344 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.238258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d112bb04-04bc-47aa-847d-598d67d0e63a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.238395 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.238344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-hub\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.238395 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.238377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.238478 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.238398 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxsv\" (UniqueName: \"kubernetes.io/projected/d112bb04-04bc-47aa-847d-598d67d0e63a-kube-api-access-5pxsv\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.238517 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.238473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.338965 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.338943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-ca\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.339367 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.338973 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d112bb04-04bc-47aa-847d-598d67d0e63a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.339367 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.339010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-hub\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.339367 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.339032 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.339367 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.339059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxsv\" (UniqueName: \"kubernetes.io/projected/d112bb04-04bc-47aa-847d-598d67d0e63a-kube-api-access-5pxsv\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.339367 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.339117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.339801 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.339781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d112bb04-04bc-47aa-847d-598d67d0e63a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.341421 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.341397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.341514 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.341461 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.341706 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.341691 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-ca\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.341770 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.341722 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d112bb04-04bc-47aa-847d-598d67d0e63a-hub\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.360815 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.360795 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxsv\" (UniqueName: \"kubernetes.io/projected/d112bb04-04bc-47aa-847d-598d67d0e63a-kube-api-access-5pxsv\") pod \"cluster-proxy-proxy-agent-64cbdc9968-5tljr\" (UID: \"d112bb04-04bc-47aa-847d-598d67d0e63a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.438488 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.438467 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" Aug 04 09:41:43.587359 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:43.587334 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr"] Aug 04 09:41:43.589571 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:43.589534 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd112bb04_04bc_47aa_847d_598d67d0e63a.slice/crio-f393389a2e9e9bb0e45df8f509b051a289f63cbcc0c2f42e4963e422ecdb9493 WatchSource:0}: Error finding container f393389a2e9e9bb0e45df8f509b051a289f63cbcc0c2f42e4963e422ecdb9493: Status 404 returned error can't find the container with id f393389a2e9e9bb0e45df8f509b051a289f63cbcc0c2f42e4963e422ecdb9493 Aug 04 09:41:44.327745 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:44.327687 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" event={"ID":"d112bb04-04bc-47aa-847d-598d67d0e63a","Type":"ContainerStarted","Data":"f393389a2e9e9bb0e45df8f509b051a289f63cbcc0c2f42e4963e422ecdb9493"} Aug 04 09:41:45.053864 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:45.053829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:45.056418 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:45.056396 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/788245c9-17a6-4535-8467-f075b920e37c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l45b4\" (UID: \"788245c9-17a6-4535-8467-f075b920e37c\") " pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:45.109612 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:45.109570 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54lnd\"" Aug 04 09:41:45.116180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:45.116157 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l45b4" Aug 04 09:41:45.653132 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:45.653080 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788245c9_17a6_4535_8467_f075b920e37c.slice/crio-645db295a07005a3ea8e7da60570c88cd72020d68af2328621b47d3865775947 WatchSource:0}: Error finding container 645db295a07005a3ea8e7da60570c88cd72020d68af2328621b47d3865775947: Status 404 returned error can't find the container with id 645db295a07005a3ea8e7da60570c88cd72020d68af2328621b47d3865775947 Aug 04 09:41:45.653260 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:45.653207 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l45b4"] Aug 04 09:41:46.336608 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:46.336555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l45b4" event={"ID":"788245c9-17a6-4535-8467-f075b920e37c","Type":"ContainerStarted","Data":"82c8545b735d8ca1ac13a9adf1bc171104326b348c7561f6e10e701bb1da6dda"} Aug 04 09:41:46.337001 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:46.336638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l45b4" event={"ID":"788245c9-17a6-4535-8467-f075b920e37c","Type":"ContainerStarted","Data":"645db295a07005a3ea8e7da60570c88cd72020d68af2328621b47d3865775947"} Aug 04 09:41:47.341722 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.341691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l45b4" event={"ID":"788245c9-17a6-4535-8467-f075b920e37c","Type":"ContainerStarted","Data":"acf7df5215b1cb3adad0e0b3ef867dc38186bafbc4991450beb7fc5f40324fd1"} Aug 04 09:41:47.343571 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.343548 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" event={"ID":"d112bb04-04bc-47aa-847d-598d67d0e63a","Type":"ContainerStarted","Data":"13482da378b2403e8016e731b8c027f95d87b6fd7b56211109f6163ff67b76cf"} Aug 04 09:41:47.343695 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.343605 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" event={"ID":"d112bb04-04bc-47aa-847d-598d67d0e63a","Type":"ContainerStarted","Data":"9de28a888386f8daba54a74a714da8f31c3ce528380884319e620cde9499be6e"} Aug 04 09:41:47.343695 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.343626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" event={"ID":"d112bb04-04bc-47aa-847d-598d67d0e63a","Type":"ContainerStarted","Data":"c009e977f3a272f620e932e794e41a1d4d8f1d28b78661cac8c0065d8a7c7014"} Aug 04 09:41:47.380097 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.380054 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64cbdc9968-5tljr" podStartSLOduration=1.051316621 podStartE2EDuration="4.380041884s" totalImagesPullingTime="3.328725263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:47.379944993 +0000 UTC m=+87.799171171" watchObservedRunningTime="2026-08-04 09:41:47.380041884 +0000 UTC m=+87.799268063" Aug 04 09:41:47.580121 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.580031 2558 patch_prober.go:28] interesting pod/image-registry-d48cd6f9b-ltqkj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 04 09:41:47.580121 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:47.580103 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" podUID="9e4763d2-12c5-433d-89d5-5df918aff016" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 09:41:49.352765 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:49.352729 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l45b4" event={"ID":"788245c9-17a6-4535-8467-f075b920e37c","Type":"ContainerStarted","Data":"3c44c3e9adc97f0aedb05f4058a876a10ad6f3bf43bc17ba772b187849db2520"} Aug 04 09:41:49.375057 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:49.375008 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l45b4" podStartSLOduration=33.730311735 podStartE2EDuration="36.374993459s" totalImagesPullingTime="2.644681724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 09:41:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:49.374817595 +0000 UTC m=+89.794043773" watchObservedRunningTime="2026-08-04 09:41:49.374993459 +0000 UTC m=+89.794219638" Aug 04 09:41:50.280501 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:50.280474 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:41:53.107895 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.107859 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-prv6c"] Aug 04 09:41:53.113344 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.113325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.116050 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.116031 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 04 09:41:53.116050 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.116045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5gwbm\"" Aug 04 09:41:53.116153 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.116045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 04 09:41:53.116653 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.116632 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 04 09:41:53.117361 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.117348 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 04 09:41:53.216088 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-sys\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216236 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-root\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216236 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-textfile\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216236 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znt45\" (UniqueName: \"kubernetes.io/projected/f88a05db-4574-4d05-90fc-aa520f4ada92-kube-api-access-znt45\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216405 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-accelerators-collector-config\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216405 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216405 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-wtmp\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216405 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88a05db-4574-4d05-90fc-aa520f4ada92-metrics-client-ca\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.216551 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.216425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-tls\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317624 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-sys\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-root\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-textfile\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znt45\" (UniqueName: \"kubernetes.io/projected/f88a05db-4574-4d05-90fc-aa520f4ada92-kube-api-access-znt45\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-accelerators-collector-config\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317708 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-sys\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.317758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317716 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-root\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-wtmp\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88a05db-4574-4d05-90fc-aa520f4ada92-metrics-client-ca\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-tls\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:53.317942 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.317962 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-wtmp\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:41:53.318014 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-tls podName:f88a05db-4574-4d05-90fc-aa520f4ada92 nodeName:}" failed. No retries permitted until 2026-08-04 09:41:53.817993395 +0000 UTC m=+94.237219552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-tls") pod "node-exporter-prv6c" (UID: "f88a05db-4574-4d05-90fc-aa520f4ada92") : secret "node-exporter-tls" not found Aug 04 09:41:53.318033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.318019 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-textfile\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318430 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.318366 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88a05db-4574-4d05-90fc-aa520f4ada92-metrics-client-ca\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.318430 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.318384 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-accelerators-collector-config\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.319929 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.319912 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.339018 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.338994 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znt45\" (UniqueName: \"kubernetes.io/projected/f88a05db-4574-4d05-90fc-aa520f4ada92-kube-api-access-znt45\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.821591 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.821557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-tls\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:53.823802 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:53.823771 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88a05db-4574-4d05-90fc-aa520f4ada92-node-exporter-tls\") pod \"node-exporter-prv6c\" (UID: \"f88a05db-4574-4d05-90fc-aa520f4ada92\") " pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:54.022003 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:54.021978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prv6c" Aug 04 09:41:54.034345 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:41:54.034323 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88a05db_4574_4d05_90fc_aa520f4ada92.slice/crio-89f19eb16738db0e86a0e542975e638ce37fa1cb0a492541eb5f760d1f8c05cf WatchSource:0}: Error finding container 89f19eb16738db0e86a0e542975e638ce37fa1cb0a492541eb5f760d1f8c05cf: Status 404 returned error can't find the container with id 89f19eb16738db0e86a0e542975e638ce37fa1cb0a492541eb5f760d1f8c05cf Aug 04 09:41:54.368695 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:54.368658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prv6c" event={"ID":"f88a05db-4574-4d05-90fc-aa520f4ada92","Type":"ContainerStarted","Data":"89f19eb16738db0e86a0e542975e638ce37fa1cb0a492541eb5f760d1f8c05cf"} Aug 04 09:41:55.373722 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:55.373687 2558 generic.go:356] "Generic (PLEG): container finished" podID="f88a05db-4574-4d05-90fc-aa520f4ada92" containerID="cfdbf5bd21ab19e1b4b93090cb46fbed5f38d95015d20d95f6009b332b533bc4" exitCode=0 Aug 04 09:41:55.374021 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:55.373767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prv6c" event={"ID":"f88a05db-4574-4d05-90fc-aa520f4ada92","Type":"ContainerDied","Data":"cfdbf5bd21ab19e1b4b93090cb46fbed5f38d95015d20d95f6009b332b533bc4"} Aug 04 09:41:56.379406 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:56.379367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prv6c" event={"ID":"f88a05db-4574-4d05-90fc-aa520f4ada92","Type":"ContainerStarted","Data":"f5a0e1a5ddee4685e525fe08666f68eb3ce5d7d26f2b01e77fe9e7cf2903c93b"} Aug 04 09:41:56.379786 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:56.379425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prv6c" event={"ID":"f88a05db-4574-4d05-90fc-aa520f4ada92","Type":"ContainerStarted","Data":"d9e7ee483b3ea8d16031e0db082fc81cdeb54c7cd5721ce59ceaea4ae91dffa3"} Aug 04 09:41:56.405934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:41:56.405891 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-prv6c" podStartSLOduration=2.2407772440000002 podStartE2EDuration="3.405877539s" totalImagesPullingTime="1.104399467s" totalInitContainerRuntime="60.700828ms" isStatefulPod=true podCreationTimestamp="2026-08-04 09:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:41:56.40539513 +0000 UTC m=+96.824621302" watchObservedRunningTime="2026-08-04 09:41:56.405877539 +0000 UTC m=+96.825103718" Aug 04 09:42:03.293559 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:03.293532 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kmwm4" Aug 04 09:42:06.259041 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:06.259005 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d48cd6f9b-ltqkj"] Aug 04 09:42:15.092451 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.092417 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664d8fb49d-d5sjq"] Aug 04 09:42:15.094343 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.094327 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.097372 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.097351 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8x9rc\"" Aug 04 09:42:15.099095 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.099069 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 04 09:42:15.099255 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.099230 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 04 09:42:15.099351 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.099289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 04 09:42:15.099664 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.099645 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 04 09:42:15.099838 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.099815 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 04 09:42:15.100240 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.100220 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 04 09:42:15.100381 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.100256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 04 09:42:15.106078 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.106055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 04 09:42:15.107854 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.107740 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d8fb49d-d5sjq"] Aug 04 09:42:15.267955 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.267921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-config\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.268112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.267966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-trusted-ca-bundle\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.268112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.267996 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-oauth-serving-cert\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.268112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.268050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-serving-cert\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.268112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.268081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-oauth-config\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.268112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.268105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-service-ca\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.268290 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.268157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf7s8\" (UniqueName: \"kubernetes.io/projected/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-kube-api-access-pf7s8\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368475 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-config\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368475 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-trusted-ca-bundle\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368475 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-oauth-serving-cert\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368759 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-serving-cert\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368759 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-oauth-config\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368759 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-service-ca\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.368759 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.368699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf7s8\" (UniqueName: \"kubernetes.io/projected/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-kube-api-access-pf7s8\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.369262 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.369240 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-oauth-serving-cert\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.369380 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.369358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-config\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.369562 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.369541 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-service-ca\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.369755 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.369734 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-trusted-ca-bundle\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.371775 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.371751 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-oauth-config\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.371930 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.371910 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-serving-cert\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.377803 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.377775 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf7s8\" (UniqueName: \"kubernetes.io/projected/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-kube-api-access-pf7s8\") pod \"console-664d8fb49d-d5sjq\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.406185 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.406162 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:15.527118 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:15.527095 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d8fb49d-d5sjq"] Aug 04 09:42:15.529137 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:42:15.529106 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ce8f0b_10d9_4672_b95b_5b86d012b9df.slice/crio-9b7a1d3b95c41c5ee86d2b7ea3dd96638a0f58801e89798eafb14ce9092dbb15 WatchSource:0}: Error finding container 9b7a1d3b95c41c5ee86d2b7ea3dd96638a0f58801e89798eafb14ce9092dbb15: Status 404 returned error can't find the container with id 9b7a1d3b95c41c5ee86d2b7ea3dd96638a0f58801e89798eafb14ce9092dbb15 Aug 04 09:42:16.444311 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:16.444277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8fb49d-d5sjq" event={"ID":"d8ce8f0b-10d9-4672-b95b-5b86d012b9df","Type":"ContainerStarted","Data":"9b7a1d3b95c41c5ee86d2b7ea3dd96638a0f58801e89798eafb14ce9092dbb15"} Aug 04 09:42:19.455109 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:19.455073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8fb49d-d5sjq" event={"ID":"d8ce8f0b-10d9-4672-b95b-5b86d012b9df","Type":"ContainerStarted","Data":"316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d"} Aug 04 09:42:19.481635 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:19.481569 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664d8fb49d-d5sjq" podStartSLOduration=1.639670369 podStartE2EDuration="4.481554799s" totalImagesPullingTime="2.84188443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:42:19.480145171 +0000 UTC m=+119.899371350" watchObservedRunningTime="2026-08-04 09:42:19.481554799 +0000 UTC m=+119.900781014" Aug 04 09:42:25.407064 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:25.407027 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:25.407435 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:25.407103 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:25.412179 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:25.412159 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:25.476940 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:25.476916 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:42:29.879875 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:29.879834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:42:29.881999 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:29.881978 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e5c4026-5523-47f3-a755-deffb7dd20a6-metrics-certs\") pod \"network-metrics-daemon-lw6n5\" (UID: \"5e5c4026-5523-47f3-a755-deffb7dd20a6\") " pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:42:30.029315 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:30.029291 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpz8l\"" Aug 04 09:42:30.036819 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:30.036801 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw6n5" Aug 04 09:42:30.161199 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:30.161173 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lw6n5"] Aug 04 09:42:30.163658 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:42:30.163630 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5c4026_5523_47f3_a755_deffb7dd20a6.slice/crio-01aa79e210af2d1147adc5b89672a001f850159f945df3e4623eb0f54e67d0d0 WatchSource:0}: Error finding container 01aa79e210af2d1147adc5b89672a001f850159f945df3e4623eb0f54e67d0d0: Status 404 returned error can't find the container with id 01aa79e210af2d1147adc5b89672a001f850159f945df3e4623eb0f54e67d0d0 Aug 04 09:42:30.491801 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:30.491721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lw6n5" event={"ID":"5e5c4026-5523-47f3-a755-deffb7dd20a6","Type":"ContainerStarted","Data":"01aa79e210af2d1147adc5b89672a001f850159f945df3e4623eb0f54e67d0d0"} Aug 04 09:42:31.277591 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.277540 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" podUID="9e4763d2-12c5-433d-89d5-5df918aff016" containerName="registry" containerID="cri-o://ee1de7e45bf1d327f646020115e5584d2a61e11eb38029956fea557f926c890f" gracePeriod=30 Aug 04 09:42:31.497389 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.497313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lw6n5" event={"ID":"5e5c4026-5523-47f3-a755-deffb7dd20a6","Type":"ContainerStarted","Data":"12b3265e8d6a3b82f8174432a97cdfa9b09bf5c1c5e78da60bf81e8ed7646c8d"} Aug 04 09:42:31.497520 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.497439 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lw6n5" event={"ID":"5e5c4026-5523-47f3-a755-deffb7dd20a6","Type":"ContainerStarted","Data":"b4010b72f539ff3b880765c5b81fb71fb3b845475183119ed6d1bdb55444daef"} Aug 04 09:42:31.498928 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.498904 2558 generic.go:356] "Generic (PLEG): container finished" podID="9e4763d2-12c5-433d-89d5-5df918aff016" containerID="ee1de7e45bf1d327f646020115e5584d2a61e11eb38029956fea557f926c890f" exitCode=0 Aug 04 09:42:31.499028 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.498961 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" event={"ID":"9e4763d2-12c5-433d-89d5-5df918aff016","Type":"ContainerDied","Data":"ee1de7e45bf1d327f646020115e5584d2a61e11eb38029956fea557f926c890f"} Aug 04 09:42:31.516277 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.516259 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:42:31.520632 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.520570 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lw6n5" podStartSLOduration=130.57005474 podStartE2EDuration="2m11.520558848s" totalImagesPullingTime="950.504108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:42:31.520160898 +0000 UTC m=+131.939387077" watchObservedRunningTime="2026-08-04 09:42:31.520558848 +0000 UTC m=+131.939785027" Aug 04 09:42:31.692992 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.692960 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-registry-certificates\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693156 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.692996 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-bound-sa-token\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693156 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693021 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e4763d2-12c5-433d-89d5-5df918aff016-ca-trust-extracted\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693156 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693052 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc8sc\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-kube-api-access-mc8sc\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693156 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693102 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693156 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693132 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-installation-pull-secrets\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693406 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693166 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-image-registry-private-configuration\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693406 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693204 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-trusted-ca\") pod \"9e4763d2-12c5-433d-89d5-5df918aff016\" (UID: \"9e4763d2-12c5-433d-89d5-5df918aff016\") " Aug 04 09:42:31.693406 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693382 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 09:42:31.693782 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.693749 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 09:42:31.695378 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.695346 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 09:42:31.695490 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.695410 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 09:42:31.695723 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.695700 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-kube-api-access-mc8sc" (OuterVolumeSpecName: "kube-api-access-mc8sc") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "kube-api-access-mc8sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 09:42:31.695844 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.695817 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 09:42:31.695885 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.695845 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 09:42:31.701649 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.701629 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e4763d2-12c5-433d-89d5-5df918aff016-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e4763d2-12c5-433d-89d5-5df918aff016" (UID: "9e4763d2-12c5-433d-89d5-5df918aff016"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 09:42:31.794024 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794003 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-registry-tls\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794024 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794022 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-installation-pull-secrets\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794032 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e4763d2-12c5-433d-89d5-5df918aff016-image-registry-private-configuration\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794042 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-trusted-ca\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794049 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e4763d2-12c5-433d-89d5-5df918aff016-registry-certificates\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794057 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-bound-sa-token\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794065 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e4763d2-12c5-433d-89d5-5df918aff016-ca-trust-extracted\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:31.794136 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:31.794074 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc8sc\" (UniqueName: \"kubernetes.io/projected/9e4763d2-12c5-433d-89d5-5df918aff016-kube-api-access-mc8sc\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:42:32.502965 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:32.502939 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" Aug 04 09:42:32.503377 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:32.502968 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d48cd6f9b-ltqkj" event={"ID":"9e4763d2-12c5-433d-89d5-5df918aff016","Type":"ContainerDied","Data":"648ddafabc65d2a02d96237eeadf9e84b2624ff8c2af2d7e8aaa0e9170c2df86"} Aug 04 09:42:32.503377 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:32.503026 2558 scope.go:117] "RemoveContainer" containerID="ee1de7e45bf1d327f646020115e5584d2a61e11eb38029956fea557f926c890f" Aug 04 09:42:32.523910 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:32.523887 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d48cd6f9b-ltqkj"] Aug 04 09:42:32.528320 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:32.528299 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d48cd6f9b-ltqkj"] Aug 04 09:42:34.016111 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:34.016079 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e4763d2-12c5-433d-89d5-5df918aff016" path="/var/lib/kubelet/pods/9e4763d2-12c5-433d-89d5-5df918aff016/volumes" Aug 04 09:42:49.558908 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:49.558876 2558 generic.go:356] "Generic (PLEG): container finished" podID="c5874556-2dc2-46ac-a799-a08b80fd43c1" containerID="a950b9c403bac914d2d05e6812f4be306386bab67d54b224da034c9bc222fa74" exitCode=0 Aug 04 09:42:49.559270 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:49.558949 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" event={"ID":"c5874556-2dc2-46ac-a799-a08b80fd43c1","Type":"ContainerDied","Data":"a950b9c403bac914d2d05e6812f4be306386bab67d54b224da034c9bc222fa74"} Aug 04 09:42:49.559270 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:49.559229 2558 scope.go:117] "RemoveContainer" containerID="a950b9c403bac914d2d05e6812f4be306386bab67d54b224da034c9bc222fa74" Aug 04 09:42:50.564550 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:42:50.564514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-8mldm" event={"ID":"c5874556-2dc2-46ac-a799-a08b80fd43c1","Type":"ContainerStarted","Data":"520a73146927d87631d676e0e8c338235ce61a6016fdfeab09802e6ffec11d11"} Aug 04 09:43:24.704213 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:24.704182 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d8fb49d-d5sjq"] Aug 04 09:43:49.722230 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:49.722165 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-664d8fb49d-d5sjq" podUID="d8ce8f0b-10d9-4672-b95b-5b86d012b9df" containerName="console" containerID="cri-o://316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d" gracePeriod=15 Aug 04 09:43:49.956106 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:49.956079 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:43:50.107700 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107637 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-config\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.107700 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107680 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-serving-cert\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.107881 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-trusted-ca-bundle\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.107881 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107759 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf7s8\" (UniqueName: \"kubernetes.io/projected/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-kube-api-access-pf7s8\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.107881 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-service-ca\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.107881 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107834 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-oauth-serving-cert\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.107881 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.107859 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-oauth-config\") pod \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\" (UID: \"d8ce8f0b-10d9-4672-b95b-5b86d012b9df\") " Aug 04 09:43:50.108094 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.108000 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-config" (OuterVolumeSpecName: "console-config") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 09:43:50.108257 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.108229 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 09:43:50.108325 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.108236 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 09:43:50.108325 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.108308 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 09:43:50.109940 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.109917 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 09:43:50.110118 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.110095 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-kube-api-access-pf7s8" (OuterVolumeSpecName: "kube-api-access-pf7s8") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "kube-api-access-pf7s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 09:43:50.110174 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.110097 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8ce8f0b-10d9-4672-b95b-5b86d012b9df" (UID: "d8ce8f0b-10d9-4672-b95b-5b86d012b9df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 09:43:50.208185 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208164 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf7s8\" (UniqueName: \"kubernetes.io/projected/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-kube-api-access-pf7s8\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.208185 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208186 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-service-ca\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.208185 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208195 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-oauth-serving-cert\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.208355 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208207 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-oauth-config\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.208355 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208220 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-config\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.208355 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208228 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-console-serving-cert\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.208355 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.208236 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ce8f0b-10d9-4672-b95b-5b86d012b9df-trusted-ca-bundle\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 09:43:50.758474 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.758444 2558 generic.go:356] "Generic (PLEG): container finished" podID="d8ce8f0b-10d9-4672-b95b-5b86d012b9df" containerID="316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d" exitCode=0 Aug 04 09:43:50.758949 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.758486 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8fb49d-d5sjq" Aug 04 09:43:50.758949 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.758502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8fb49d-d5sjq" event={"ID":"d8ce8f0b-10d9-4672-b95b-5b86d012b9df","Type":"ContainerDied","Data":"316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d"} Aug 04 09:43:50.758949 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.758552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8fb49d-d5sjq" event={"ID":"d8ce8f0b-10d9-4672-b95b-5b86d012b9df","Type":"ContainerDied","Data":"9b7a1d3b95c41c5ee86d2b7ea3dd96638a0f58801e89798eafb14ce9092dbb15"} Aug 04 09:43:50.758949 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.758611 2558 scope.go:117] "RemoveContainer" containerID="316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d" Aug 04 09:43:50.766464 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.766450 2558 scope.go:117] "RemoveContainer" containerID="316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d" Aug 04 09:43:50.766809 ip-10-0-135-46 kubenswrapper[2558]: E0804 09:43:50.766771 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d\": container with ID starting with 316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d not found: ID does not exist" containerID="316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d" Aug 04 09:43:50.766903 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.766813 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d"} err="failed to get container status \"316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d\": rpc error: code = NotFound desc = could not find container \"316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d\": container with ID starting with 316c18265ed76829988560586ea9036ea61818a7b45306c45b198919b2aff14d not found: ID does not exist" Aug 04 09:43:50.786521 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.786500 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d8fb49d-d5sjq"] Aug 04 09:43:50.790542 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:50.790523 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664d8fb49d-d5sjq"] Aug 04 09:43:52.015841 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:43:52.015801 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8ce8f0b-10d9-4672-b95b-5b86d012b9df" path="/var/lib/kubelet/pods/d8ce8f0b-10d9-4672-b95b-5b86d012b9df/volumes" Aug 04 09:44:46.891482 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891407 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj"] Aug 04 09:44:46.891934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891641 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e4763d2-12c5-433d-89d5-5df918aff016" containerName="registry" Aug 04 09:44:46.891934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891651 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e4763d2-12c5-433d-89d5-5df918aff016" containerName="registry" Aug 04 09:44:46.891934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891670 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ce8f0b-10d9-4672-b95b-5b86d012b9df" containerName="console" Aug 04 09:44:46.891934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891676 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ce8f0b-10d9-4672-b95b-5b86d012b9df" containerName="console" Aug 04 09:44:46.891934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891714 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e4763d2-12c5-433d-89d5-5df918aff016" containerName="registry" Aug 04 09:44:46.891934 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.891723 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ce8f0b-10d9-4672-b95b-5b86d012b9df" containerName="console" Aug 04 09:44:46.894391 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.894374 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:46.905745 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.905724 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Aug 04 09:44:46.929687 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.929665 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Aug 04 09:44:46.929942 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.929927 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-42wwn\"" Aug 04 09:44:46.981013 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.980988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a194aa06-db43-42cd-aa1b-108fca88e5cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhkkj\" (UID: \"a194aa06-db43-42cd-aa1b-108fca88e5cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:46.981109 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.981022 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jnh\" (UniqueName: \"kubernetes.io/projected/a194aa06-db43-42cd-aa1b-108fca88e5cb-kube-api-access-b8jnh\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhkkj\" (UID: \"a194aa06-db43-42cd-aa1b-108fca88e5cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:46.983909 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:46.983891 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj"] Aug 04 09:44:47.081963 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.081941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a194aa06-db43-42cd-aa1b-108fca88e5cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhkkj\" (UID: \"a194aa06-db43-42cd-aa1b-108fca88e5cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:47.082057 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.081969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jnh\" (UniqueName: \"kubernetes.io/projected/a194aa06-db43-42cd-aa1b-108fca88e5cb-kube-api-access-b8jnh\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhkkj\" (UID: \"a194aa06-db43-42cd-aa1b-108fca88e5cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:47.082352 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.082329 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a194aa06-db43-42cd-aa1b-108fca88e5cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhkkj\" (UID: \"a194aa06-db43-42cd-aa1b-108fca88e5cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:47.232984 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.232955 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jnh\" (UniqueName: \"kubernetes.io/projected/a194aa06-db43-42cd-aa1b-108fca88e5cb-kube-api-access-b8jnh\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhkkj\" (UID: \"a194aa06-db43-42cd-aa1b-108fca88e5cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:47.502715 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.502645 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" Aug 04 09:44:47.656302 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.656275 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj"] Aug 04 09:44:47.659432 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:44:47.659404 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda194aa06_db43_42cd_aa1b_108fca88e5cb.slice/crio-ab15d123e957e002a1f32e0411755209411726e5cbf5b42f4ec9d4511965be40 WatchSource:0}: Error finding container ab15d123e957e002a1f32e0411755209411726e5cbf5b42f4ec9d4511965be40: Status 404 returned error can't find the container with id ab15d123e957e002a1f32e0411755209411726e5cbf5b42f4ec9d4511965be40 Aug 04 09:44:47.940790 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:47.940764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" event={"ID":"a194aa06-db43-42cd-aa1b-108fca88e5cb","Type":"ContainerStarted","Data":"ab15d123e957e002a1f32e0411755209411726e5cbf5b42f4ec9d4511965be40"} Aug 04 09:44:50.954758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:50.954707 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" event={"ID":"a194aa06-db43-42cd-aa1b-108fca88e5cb","Type":"ContainerStarted","Data":"db0d91a5573539ea36de5733ae79029cb30b07e7af987152c4f8c0dc63e87eb2"} Aug 04 09:44:51.134557 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:51.134500 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhkkj" podStartSLOduration=2.7265346089999998 podStartE2EDuration="5.134484776s" totalImagesPullingTime="2.407950167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:44:51.134037421 +0000 UTC m=+271.553263599" watchObservedRunningTime="2026-08-04 09:44:51.134484776 +0000 UTC m=+271.553710954" Aug 04 09:44:54.580071 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.580039 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx"] Aug 04 09:44:54.583271 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.583257 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.586373 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.586353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cgdst\"" Aug 04 09:44:54.587494 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.587476 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 04 09:44:54.587593 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.587520 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 04 09:44:54.596459 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.596437 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx"] Aug 04 09:44:54.633701 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.633677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3729f495-9288-4b1c-a98d-117b79650613-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lc2gx\" (UID: \"3729f495-9288-4b1c-a98d-117b79650613\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.633788 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.633708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gq6w\" (UniqueName: \"kubernetes.io/projected/3729f495-9288-4b1c-a98d-117b79650613-kube-api-access-4gq6w\") pod \"cert-manager-cainjector-559cdd8c87-lc2gx\" (UID: \"3729f495-9288-4b1c-a98d-117b79650613\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.734571 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.734549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3729f495-9288-4b1c-a98d-117b79650613-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lc2gx\" (UID: \"3729f495-9288-4b1c-a98d-117b79650613\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.734680 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.734592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gq6w\" (UniqueName: \"kubernetes.io/projected/3729f495-9288-4b1c-a98d-117b79650613-kube-api-access-4gq6w\") pod \"cert-manager-cainjector-559cdd8c87-lc2gx\" (UID: \"3729f495-9288-4b1c-a98d-117b79650613\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.744844 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.744819 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3729f495-9288-4b1c-a98d-117b79650613-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lc2gx\" (UID: \"3729f495-9288-4b1c-a98d-117b79650613\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.745048 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.745028 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gq6w\" (UniqueName: \"kubernetes.io/projected/3729f495-9288-4b1c-a98d-117b79650613-kube-api-access-4gq6w\") pod \"cert-manager-cainjector-559cdd8c87-lc2gx\" (UID: \"3729f495-9288-4b1c-a98d-117b79650613\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:54.892181 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:54.892126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" Aug 04 09:44:55.015128 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:55.015107 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx"] Aug 04 09:44:55.017214 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:44:55.017190 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3729f495_9288_4b1c_a98d_117b79650613.slice/crio-2da0e8c841e46814c83e517c365ca3ca61b407f4bb01834478e36fca0015107f WatchSource:0}: Error finding container 2da0e8c841e46814c83e517c365ca3ca61b407f4bb01834478e36fca0015107f: Status 404 returned error can't find the container with id 2da0e8c841e46814c83e517c365ca3ca61b407f4bb01834478e36fca0015107f Aug 04 09:44:55.972969 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:55.972929 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" event={"ID":"3729f495-9288-4b1c-a98d-117b79650613","Type":"ContainerStarted","Data":"2da0e8c841e46814c83e517c365ca3ca61b407f4bb01834478e36fca0015107f"} Aug 04 09:44:57.981481 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:57.981443 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" event={"ID":"3729f495-9288-4b1c-a98d-117b79650613","Type":"ContainerStarted","Data":"f94800dbc56b81008efb3576b7e7b565f6750a486437089cdb8966b3c8fe9e9d"} Aug 04 09:44:58.029895 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:44:58.029837 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lc2gx" podStartSLOduration=1.214143113 podStartE2EDuration="4.029816676s" totalImagesPullingTime="2.815673563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:44:58.028504292 +0000 UTC m=+278.447730495" watchObservedRunningTime="2026-08-04 09:44:58.029816676 +0000 UTC m=+278.449042856" Aug 04 09:45:01.839991 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.839959 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wsjnr"] Aug 04 09:45:01.843073 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.843055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:01.849150 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.848844 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b785q\"" Aug 04 09:45:01.853676 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.853653 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wsjnr"] Aug 04 09:45:01.883904 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.883876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c45ece67-5c57-4b31-aa18-91af5f276efb-bound-sa-token\") pod \"cert-manager-55b4d954d5-wsjnr\" (UID: \"c45ece67-5c57-4b31-aa18-91af5f276efb\") " pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:01.884006 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.883907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2752\" (UniqueName: \"kubernetes.io/projected/c45ece67-5c57-4b31-aa18-91af5f276efb-kube-api-access-x2752\") pod \"cert-manager-55b4d954d5-wsjnr\" (UID: \"c45ece67-5c57-4b31-aa18-91af5f276efb\") " pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:01.984363 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.984332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c45ece67-5c57-4b31-aa18-91af5f276efb-bound-sa-token\") pod \"cert-manager-55b4d954d5-wsjnr\" (UID: \"c45ece67-5c57-4b31-aa18-91af5f276efb\") " pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:01.984495 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.984371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2752\" (UniqueName: \"kubernetes.io/projected/c45ece67-5c57-4b31-aa18-91af5f276efb-kube-api-access-x2752\") pod \"cert-manager-55b4d954d5-wsjnr\" (UID: \"c45ece67-5c57-4b31-aa18-91af5f276efb\") " pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:01.994125 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.994102 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c45ece67-5c57-4b31-aa18-91af5f276efb-bound-sa-token\") pod \"cert-manager-55b4d954d5-wsjnr\" (UID: \"c45ece67-5c57-4b31-aa18-91af5f276efb\") " pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:01.994239 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:01.994205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2752\" (UniqueName: \"kubernetes.io/projected/c45ece67-5c57-4b31-aa18-91af5f276efb-kube-api-access-x2752\") pod \"cert-manager-55b4d954d5-wsjnr\" (UID: \"c45ece67-5c57-4b31-aa18-91af5f276efb\") " pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:02.152094 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:02.152070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wsjnr" Aug 04 09:45:02.287362 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:02.287324 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wsjnr"] Aug 04 09:45:02.290846 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:45:02.290818 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc45ece67_5c57_4b31_aa18_91af5f276efb.slice/crio-0b221a775d85125397b9ecb0cfdaf9036bf11de2121fc2f0b645138f98629a8c WatchSource:0}: Error finding container 0b221a775d85125397b9ecb0cfdaf9036bf11de2121fc2f0b645138f98629a8c: Status 404 returned error can't find the container with id 0b221a775d85125397b9ecb0cfdaf9036bf11de2121fc2f0b645138f98629a8c Aug 04 09:45:02.999012 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:02.998976 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wsjnr" event={"ID":"c45ece67-5c57-4b31-aa18-91af5f276efb","Type":"ContainerStarted","Data":"0dda4e9d51736c7129a597226a54f63285fec94da4ff9807f981f33e3ff4506f"} Aug 04 09:45:02.999458 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:02.999021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wsjnr" event={"ID":"c45ece67-5c57-4b31-aa18-91af5f276efb","Type":"ContainerStarted","Data":"0b221a775d85125397b9ecb0cfdaf9036bf11de2121fc2f0b645138f98629a8c"} Aug 04 09:45:03.022233 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:03.022182 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wsjnr" podStartSLOduration=2.022167495 podStartE2EDuration="2.022167495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:45:03.020286335 +0000 UTC m=+283.439512513" watchObservedRunningTime="2026-08-04 09:45:03.022167495 +0000 UTC m=+283.441393685" Aug 04 09:45:19.936605 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:19.936560 2558 kubelet.go:1648] "Image garbage collection succeeded" Aug 04 09:45:23.754335 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.754294 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh"] Aug 04 09:45:23.758768 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.758753 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.768808 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.768779 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Aug 04 09:45:23.772371 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.772357 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Aug 04 09:45:23.772456 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.772437 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Aug 04 09:45:23.772494 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.772482 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Aug 04 09:45:23.774352 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.774338 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Aug 04 09:45:23.775868 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.775855 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t997z\"" Aug 04 09:45:23.825912 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.825889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0b48f91-65bb-4186-b43a-d71c84f0bbac-cert\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.826021 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.825917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0b48f91-65bb-4186-b43a-d71c84f0bbac-manager-config\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.826021 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.825945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0b48f91-65bb-4186-b43a-d71c84f0bbac-metrics-cert\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.826021 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.825960 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7l77\" (UniqueName: \"kubernetes.io/projected/b0b48f91-65bb-4186-b43a-d71c84f0bbac-kube-api-access-h7l77\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.883913 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.883887 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh"] Aug 04 09:45:23.926588 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.926563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0b48f91-65bb-4186-b43a-d71c84f0bbac-metrics-cert\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.926690 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.926609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7l77\" (UniqueName: \"kubernetes.io/projected/b0b48f91-65bb-4186-b43a-d71c84f0bbac-kube-api-access-h7l77\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.926690 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.926664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0b48f91-65bb-4186-b43a-d71c84f0bbac-cert\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.926690 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.926682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0b48f91-65bb-4186-b43a-d71c84f0bbac-manager-config\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.927346 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.927326 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0b48f91-65bb-4186-b43a-d71c84f0bbac-manager-config\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.928957 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.928933 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0b48f91-65bb-4186-b43a-d71c84f0bbac-cert\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:23.929033 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:23.928997 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0b48f91-65bb-4186-b43a-d71c84f0bbac-metrics-cert\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:24.035541 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:24.035479 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7l77\" (UniqueName: \"kubernetes.io/projected/b0b48f91-65bb-4186-b43a-d71c84f0bbac-kube-api-access-h7l77\") pod \"lws-controller-manager-78b8bf7c54-k6xqh\" (UID: \"b0b48f91-65bb-4186-b43a-d71c84f0bbac\") " pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:24.067298 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:24.067272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:24.224413 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:24.224385 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh"] Aug 04 09:45:24.227426 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:45:24.227399 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b48f91_65bb_4186_b43a_d71c84f0bbac.slice/crio-47cfa4ea1b3aba03b907576e671c6657f37afdf07f91c7212741461f64ccc8b7 WatchSource:0}: Error finding container 47cfa4ea1b3aba03b907576e671c6657f37afdf07f91c7212741461f64ccc8b7: Status 404 returned error can't find the container with id 47cfa4ea1b3aba03b907576e671c6657f37afdf07f91c7212741461f64ccc8b7 Aug 04 09:45:24.229467 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:24.229448 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 09:45:25.076938 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.076888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" event={"ID":"b0b48f91-65bb-4186-b43a-d71c84f0bbac","Type":"ContainerStarted","Data":"47cfa4ea1b3aba03b907576e671c6657f37afdf07f91c7212741461f64ccc8b7"} Aug 04 09:45:25.293230 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.293163 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n"] Aug 04 09:45:25.296551 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.296525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.300410 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.300353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 04 09:45:25.300536 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.300494 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 04 09:45:25.300870 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.300851 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9nfsq\"" Aug 04 09:45:25.301170 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.301147 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 04 09:45:25.301266 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.301193 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 04 09:45:25.323444 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.323415 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n"] Aug 04 09:45:25.336563 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.336476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a4ac698-4015-4f65-9337-4e53986d7d46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.336563 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.336527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a4ac698-4015-4f65-9337-4e53986d7d46-tmp\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.336758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.336565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkl48\" (UniqueName: \"kubernetes.io/projected/4a4ac698-4015-4f65-9337-4e53986d7d46-kube-api-access-bkl48\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.336758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.336631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a4ac698-4015-4f65-9337-4e53986d7d46-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.336758 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.336668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a4ac698-4015-4f65-9337-4e53986d7d46-manifests\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.437448 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.437417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a4ac698-4015-4f65-9337-4e53986d7d46-tmp\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.437629 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.437470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkl48\" (UniqueName: \"kubernetes.io/projected/4a4ac698-4015-4f65-9337-4e53986d7d46-kube-api-access-bkl48\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.437629 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.437506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a4ac698-4015-4f65-9337-4e53986d7d46-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.437629 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.437540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a4ac698-4015-4f65-9337-4e53986d7d46-manifests\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.437629 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.437620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a4ac698-4015-4f65-9337-4e53986d7d46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.438232 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.438188 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a4ac698-4015-4f65-9337-4e53986d7d46-manifests\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.440464 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.440442 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a4ac698-4015-4f65-9337-4e53986d7d46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.440464 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.440457 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a4ac698-4015-4f65-9337-4e53986d7d46-tmp\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.440952 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.440929 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a4ac698-4015-4f65-9337-4e53986d7d46-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.479587 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.479547 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkl48\" (UniqueName: \"kubernetes.io/projected/4a4ac698-4015-4f65-9337-4e53986d7d46-kube-api-access-bkl48\") pod \"opendatahub-operator-controller-manager-7bb649b865-6bh4n\" (UID: \"4a4ac698-4015-4f65-9337-4e53986d7d46\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:25.610812 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:25.610718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:26.694445 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:26.694418 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n"] Aug 04 09:45:26.695994 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:45:26.695957 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4ac698_4015_4f65_9337_4e53986d7d46.slice/crio-115ac1490b1ee47653031634667c7a4c7db888229ac2e84120832ce9ac60d90c WatchSource:0}: Error finding container 115ac1490b1ee47653031634667c7a4c7db888229ac2e84120832ce9ac60d90c: Status 404 returned error can't find the container with id 115ac1490b1ee47653031634667c7a4c7db888229ac2e84120832ce9ac60d90c Aug 04 09:45:27.086819 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:27.086782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" event={"ID":"b0b48f91-65bb-4186-b43a-d71c84f0bbac","Type":"ContainerStarted","Data":"f91fafa1ceef2de63513d89156149e1af18945355431d4a5fe9493cf6096531f"} Aug 04 09:45:27.086975 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:27.086841 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:27.087982 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:27.087960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" event={"ID":"4a4ac698-4015-4f65-9337-4e53986d7d46","Type":"ContainerStarted","Data":"115ac1490b1ee47653031634667c7a4c7db888229ac2e84120832ce9ac60d90c"} Aug 04 09:45:27.105009 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:27.104959 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" podStartSLOduration=1.732061337 podStartE2EDuration="4.104943946s" totalImagesPullingTime="2.372882609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:45:27.104842569 +0000 UTC m=+307.524068749" watchObservedRunningTime="2026-08-04 09:45:27.104943946 +0000 UTC m=+307.524170126" Aug 04 09:45:30.102371 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:30.102334 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" event={"ID":"4a4ac698-4015-4f65-9337-4e53986d7d46","Type":"ContainerStarted","Data":"0d1768b28c7a7b307ab9e76f3d1c0a8066fe57d3804767e610c62fcd6558a4c8"} Aug 04 09:45:31.108041 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:31.108007 2558 generic.go:356] "Generic (PLEG): container finished" podID="4a4ac698-4015-4f65-9337-4e53986d7d46" containerID="0d1768b28c7a7b307ab9e76f3d1c0a8066fe57d3804767e610c62fcd6558a4c8" exitCode=0 Aug 04 09:45:31.108478 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:31.108093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" event={"ID":"4a4ac698-4015-4f65-9337-4e53986d7d46","Type":"ContainerDied","Data":"0d1768b28c7a7b307ab9e76f3d1c0a8066fe57d3804767e610c62fcd6558a4c8"} Aug 04 09:45:32.114489 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:32.114410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" event={"ID":"4a4ac698-4015-4f65-9337-4e53986d7d46","Type":"ContainerStarted","Data":"67f930eff32796790ecd7d9a6a69eb944e3dc4bb9340cd6f80f316a7fd872c01"} Aug 04 09:45:32.114864 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:32.114522 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:45:32.146080 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:32.146029 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" podStartSLOduration=2.657691335 podStartE2EDuration="7.146015287s" totalImagesPullingTime="3.486298573s" totalInitContainerRuntime="1.002025379s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:45:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:45:32.14427298 +0000 UTC m=+312.563499158" watchObservedRunningTime="2026-08-04 09:45:32.146015287 +0000 UTC m=+312.565241468" Aug 04 09:45:38.095884 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:38.095853 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78b8bf7c54-k6xqh" Aug 04 09:45:43.120742 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:45:43.120712 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb649b865-6bh4n" Aug 04 09:46:02.678041 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.678004 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8"] Aug 04 09:46:02.686198 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.686173 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.691383 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.691357 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Aug 04 09:46:02.691532 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.691357 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 04 09:46:02.691532 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.691461 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 04 09:46:02.696190 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.696167 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Aug 04 09:46:02.696406 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.696388 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Aug 04 09:46:02.696510 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.696397 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rqntt\"" Aug 04 09:46:02.702895 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.702879 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 04 09:46:02.713617 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.713596 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8"] Aug 04 09:46:02.797397 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.797496 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9771fd82-0fe2-4223-85b7-0d07314ede17-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.797496 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.797496 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.797634 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.797634 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.797634 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.797618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwcxt\" (UniqueName: \"kubernetes.io/projected/9771fd82-0fe2-4223-85b7-0d07314ede17-kube-api-access-hwcxt\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.898829 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.898802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9771fd82-0fe2-4223-85b7-0d07314ede17-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.898923 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.898835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.898923 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.898858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.898923 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.898874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.898923 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.898898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.899112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.899023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwcxt\" (UniqueName: \"kubernetes.io/projected/9771fd82-0fe2-4223-85b7-0d07314ede17-kube-api-access-hwcxt\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.899112 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.899058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.899678 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.899653 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.901312 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.901281 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.901312 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.901294 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.901312 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.901281 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9771fd82-0fe2-4223-85b7-0d07314ede17-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.901471 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.901333 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.913446 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.913425 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9771fd82-0fe2-4223-85b7-0d07314ede17-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.961413 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.961352 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwcxt\" (UniqueName: \"kubernetes.io/projected/9771fd82-0fe2-4223-85b7-0d07314ede17-kube-api-access-hwcxt\") pod \"istiod-openshift-gateway-5677ccb49b-pw9s8\" (UID: \"9771fd82-0fe2-4223-85b7-0d07314ede17\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:02.995195 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:02.995169 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:03.152338 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:03.152312 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8"] Aug 04 09:46:03.155258 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:46:03.155233 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9771fd82_0fe2_4223_85b7_0d07314ede17.slice/crio-055c428822a48172f99fc7a8b0d7535cd2272919115e8cf9038daaf300253d5a WatchSource:0}: Error finding container 055c428822a48172f99fc7a8b0d7535cd2272919115e8cf9038daaf300253d5a: Status 404 returned error can't find the container with id 055c428822a48172f99fc7a8b0d7535cd2272919115e8cf9038daaf300253d5a Aug 04 09:46:03.227491 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:03.227425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" event={"ID":"9771fd82-0fe2-4223-85b7-0d07314ede17","Type":"ContainerStarted","Data":"055c428822a48172f99fc7a8b0d7535cd2272919115e8cf9038daaf300253d5a"} Aug 04 09:46:06.166154 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:06.166117 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 04 09:46:06.166393 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:06.166183 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 04 09:46:06.240961 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:06.240931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" event={"ID":"9771fd82-0fe2-4223-85b7-0d07314ede17","Type":"ContainerStarted","Data":"1b2585371101dd7a18169d0c3c0fad1cc3362a3d11dc8aa1e6365fb743c7cdb0"} Aug 04 09:46:06.241075 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:06.241035 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:46:06.367537 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:06.367472 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" podStartSLOduration=1.358837084 podStartE2EDuration="4.367450776s" totalImagesPullingTime="3.008613692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:46:06.35755509 +0000 UTC m=+346.776781269" watchObservedRunningTime="2026-08-04 09:46:06.367450776 +0000 UTC m=+346.786676961" Aug 04 09:46:07.246492 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:07.246459 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-pw9s8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 04 09:46:07.246871 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:07.246518 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" podUID="9771fd82-0fe2-4223-85b7-0d07314ede17" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 09:46:10.246455 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:46:10.246424 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8" Aug 04 09:48:23.763920 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.763887 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:48:23.766995 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.766978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:23.769694 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.769674 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Aug 04 09:48:23.769796 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.769776 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 04 09:48:23.770917 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.770896 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 04 09:48:23.771004 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.770906 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-878ss\"" Aug 04 09:48:23.776898 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.776878 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:48:23.803169 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.803140 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:48:23.876180 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.876155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e7b969e7-a33f-4d05-a816-ae9629b0067e-config-file\") pod \"limitador-limitador-85d9db4d5d-9cm4n\" (UID: \"e7b969e7-a33f-4d05-a816-ae9629b0067e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:23.876269 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.876183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m72z\" (UniqueName: \"kubernetes.io/projected/e7b969e7-a33f-4d05-a816-ae9629b0067e-kube-api-access-7m72z\") pod \"limitador-limitador-85d9db4d5d-9cm4n\" (UID: \"e7b969e7-a33f-4d05-a816-ae9629b0067e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:23.976616 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.976572 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e7b969e7-a33f-4d05-a816-ae9629b0067e-config-file\") pod \"limitador-limitador-85d9db4d5d-9cm4n\" (UID: \"e7b969e7-a33f-4d05-a816-ae9629b0067e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:23.976708 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.976619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m72z\" (UniqueName: \"kubernetes.io/projected/e7b969e7-a33f-4d05-a816-ae9629b0067e-kube-api-access-7m72z\") pod \"limitador-limitador-85d9db4d5d-9cm4n\" (UID: \"e7b969e7-a33f-4d05-a816-ae9629b0067e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:23.977193 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.977175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e7b969e7-a33f-4d05-a816-ae9629b0067e-config-file\") pod \"limitador-limitador-85d9db4d5d-9cm4n\" (UID: \"e7b969e7-a33f-4d05-a816-ae9629b0067e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:23.991369 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:23.991338 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m72z\" (UniqueName: \"kubernetes.io/projected/e7b969e7-a33f-4d05-a816-ae9629b0067e-kube-api-access-7m72z\") pod \"limitador-limitador-85d9db4d5d-9cm4n\" (UID: \"e7b969e7-a33f-4d05-a816-ae9629b0067e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:24.077073 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:24.077011 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:24.204674 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:24.204647 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:48:24.206235 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:48:24.206210 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b969e7_a33f_4d05_a816_ae9629b0067e.slice/crio-8151b72d2b68a7a5e31ae3ec243366c13772c75ba256b371087041a4541b0ffb WatchSource:0}: Error finding container 8151b72d2b68a7a5e31ae3ec243366c13772c75ba256b371087041a4541b0ffb: Status 404 returned error can't find the container with id 8151b72d2b68a7a5e31ae3ec243366c13772c75ba256b371087041a4541b0ffb Aug 04 09:48:24.767708 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:24.767670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" event={"ID":"e7b969e7-a33f-4d05-a816-ae9629b0067e","Type":"ContainerStarted","Data":"8151b72d2b68a7a5e31ae3ec243366c13772c75ba256b371087041a4541b0ffb"} Aug 04 09:48:26.777663 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:26.777628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" event={"ID":"e7b969e7-a33f-4d05-a816-ae9629b0067e","Type":"ContainerStarted","Data":"3360170429de66cdfc780c00ec3c7d289b9a33b29dace7c20f1bf7efc6fb1517"} Aug 04 09:48:26.777993 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:26.777714 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:48:26.806412 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:26.806372 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" podStartSLOduration=1.341521551 podStartE2EDuration="3.806358645s" totalImagesPullingTime="2.464837094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:48:26.804602374 +0000 UTC m=+487.223828551" watchObservedRunningTime="2026-08-04 09:48:26.806358645 +0000 UTC m=+487.225584872" Aug 04 09:48:37.783074 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:48:37.783046 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n" Aug 04 09:49:38.241389 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:49:38.241355 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:49:52.657925 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:49:52.657892 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:50:01.157874 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:01.157834 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:50:16.453977 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:16.453946 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:50:20.780895 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.780860 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt"] Aug 04 09:50:20.783884 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.783868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.785323 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.785293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.785458 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.785403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrljm\" (UniqueName: \"kubernetes.io/projected/38da1d3e-419c-4284-912f-2c006d3ee8d9-kube-api-access-rrljm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.785458 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.785435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38da1d3e-419c-4284-912f-2c006d3ee8d9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.785552 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.785468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.785552 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.785499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.785664 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.785554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.790817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.790800 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 04 09:50:20.791555 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.791540 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z7ff4\"" Aug 04 09:50:20.791646 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.791553 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 04 09:50:20.792502 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.792487 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Aug 04 09:50:20.811754 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.811733 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt"] Aug 04 09:50:20.886374 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrljm\" (UniqueName: \"kubernetes.io/projected/38da1d3e-419c-4284-912f-2c006d3ee8d9-kube-api-access-rrljm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886470 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38da1d3e-419c-4284-912f-2c006d3ee8d9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886470 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886470 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886470 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886696 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886887 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886864 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886887 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886879 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.886986 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.886913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.888756 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.888736 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38da1d3e-419c-4284-912f-2c006d3ee8d9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.888924 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.888907 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38da1d3e-419c-4284-912f-2c006d3ee8d9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:20.904566 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:20.904540 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrljm\" (UniqueName: \"kubernetes.io/projected/38da1d3e-419c-4284-912f-2c006d3ee8d9-kube-api-access-rrljm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt\" (UID: \"38da1d3e-419c-4284-912f-2c006d3ee8d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:21.094372 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:21.094302 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:21.219859 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:21.219832 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt"] Aug 04 09:50:21.221633 ip-10-0-135-46 kubenswrapper[2558]: W0804 09:50:21.221609 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38da1d3e_419c_4284_912f_2c006d3ee8d9.slice/crio-a5f7feab4ea96ba5a919f34b28c675a45722e031b5576448718192232575183b WatchSource:0}: Error finding container a5f7feab4ea96ba5a919f34b28c675a45722e031b5576448718192232575183b: Status 404 returned error can't find the container with id a5f7feab4ea96ba5a919f34b28c675a45722e031b5576448718192232575183b Aug 04 09:50:22.044186 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:22.044151 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:50:22.215101 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:22.215068 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" event={"ID":"38da1d3e-419c-4284-912f-2c006d3ee8d9","Type":"ContainerStarted","Data":"a5f7feab4ea96ba5a919f34b28c675a45722e031b5576448718192232575183b"} Aug 04 09:50:23.220076 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:23.220043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" event={"ID":"38da1d3e-419c-4284-912f-2c006d3ee8d9","Type":"ContainerStarted","Data":"192b1804a00129e9162aa797f4a20aa12fec74a1f3c82b3fcfdfa79db588127b"} Aug 04 09:50:23.249871 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:23.249823 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" podStartSLOduration=2.275363747 podStartE2EDuration="3.249807963s" totalImagesPullingTime="974.444216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 09:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 09:50:23.249048561 +0000 UTC m=+603.668274739" watchObservedRunningTime="2026-08-04 09:50:23.249807963 +0000 UTC m=+603.669034161" Aug 04 09:50:31.094617 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:31.094568 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:31.096958 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:31.094646 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:31.107066 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:31.107044 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:31.263976 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:31.263950 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt" Aug 04 09:50:46.347759 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:46.347685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:50:56.257684 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:50:56.257649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:52:21.101751 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:52:21.101678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:52:30.884842 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:52:30.884805 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:52:44.227126 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:52:44.227092 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:54:23.144601 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:54:23.144544 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:54:32.737873 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:54:32.737836 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:55:32.559248 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:55:32.559213 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:55:39.337020 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:55:39.336985 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:55:54.939116 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:55:54.939083 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:56:01.737184 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:56:01.737152 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:56:10.643885 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:56:10.643851 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:56:19.147769 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:56:19.147733 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:56:31.360764 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:56:31.360731 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:56:36.661460 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:56:36.661427 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:56:41.940196 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:56:41.940156 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:57:03.766983 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:57:03.766953 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:57:14.645663 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:57:14.645625 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:57:40.484164 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:57:40.484127 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:57:50.985557 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:57:50.985522 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:57:57.218652 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:57:57.218618 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:58:05.672817 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:58:05.672779 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:58:17.132971 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:58:17.132893 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:58:22.463214 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:58:22.463181 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:58:32.585706 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:58:32.585672 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:58:42.740487 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:58:42.740448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:58:52.366360 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:58:52.366325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:59:00.314272 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:59:00.314234 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:59:13.748460 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:59:13.748425 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:59:21.932335 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:59:21.932304 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:59:27.044665 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:59:27.044632 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 09:59:37.548351 ip-10-0-135-46 kubenswrapper[2558]: I0804 09:59:37.548323 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:00:00.155073 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.154984 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96"] Aug 04 10:00:00.158193 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.158173 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" Aug 04 10:00:00.163135 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.163115 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wcn8d\"" Aug 04 10:00:00.167082 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.167062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" Aug 04 10:00:00.179029 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.179003 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96"] Aug 04 10:00:00.514465 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.514394 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96"] Aug 04 10:00:00.517368 ip-10-0-135-46 kubenswrapper[2558]: W0804 10:00:00.517339 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1af0b62_7768_463c_8b3a_5cf52820064c.slice/crio-055a54502d29616ee3e379c87cf9ba81427426915f4e81b17d40531d9634db86 WatchSource:0}: Error finding container 055a54502d29616ee3e379c87cf9ba81427426915f4e81b17d40531d9634db86: Status 404 returned error can't find the container with id 055a54502d29616ee3e379c87cf9ba81427426915f4e81b17d40531d9634db86 Aug 04 10:00:00.519314 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:00.519297 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 10:00:01.461665 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:01.461629 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" event={"ID":"a1af0b62-7768-463c-8b3a-5cf52820064c","Type":"ContainerStarted","Data":"055a54502d29616ee3e379c87cf9ba81427426915f4e81b17d40531d9634db86"} Aug 04 10:00:04.477346 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:04.477314 2558 generic.go:356] "Generic (PLEG): container finished" podID="a1af0b62-7768-463c-8b3a-5cf52820064c" containerID="e4e40ecfd59263f802702f911c622be8e1822419bb61ef7ca2be918963f7c55c" exitCode=0 Aug 04 10:00:04.477689 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:04.477370 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" event={"ID":"a1af0b62-7768-463c-8b3a-5cf52820064c","Type":"ContainerDied","Data":"e4e40ecfd59263f802702f911c622be8e1822419bb61ef7ca2be918963f7c55c"} Aug 04 10:00:05.603956 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:05.603931 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" Aug 04 10:00:06.486163 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:06.486132 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" Aug 04 10:00:06.486324 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:06.486137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763960-pqq96" event={"ID":"a1af0b62-7768-463c-8b3a-5cf52820064c","Type":"ContainerDied","Data":"055a54502d29616ee3e379c87cf9ba81427426915f4e81b17d40531d9634db86"} Aug 04 10:00:06.486324 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:00:06.486289 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="055a54502d29616ee3e379c87cf9ba81427426915f4e81b17d40531d9634db86" Aug 04 10:01:54.229012 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:01:54.228977 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:01:59.852879 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:01:59.852843 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:02:26.032113 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:02:26.032080 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:02:45.560538 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:02:45.560450 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:02:52.734861 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:02:52.734824 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:01.046107 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:01.046073 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:06.177755 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:06.177720 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:16.736979 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:16.736934 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:23.201921 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:23.201886 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:32.245674 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:32.245635 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:37.463334 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:37.463298 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:47.656281 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:47.656246 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:03:54.444139 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:03:54.444104 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:04:02.447167 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:04:02.447133 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:04:09.443796 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:04:09.443765 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:04:26.551657 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:04:26.551565 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:04:34.535405 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:04:34.535375 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:04:56.543626 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:04:56.543589 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:05:09.648767 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:05:09.648735 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:05:56.453310 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:05:56.453232 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:08.852935 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:08.852903 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:15.056084 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:15.056051 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:23.079359 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:23.079328 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:28.893367 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:28.893327 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:36.541861 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:36.541827 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:47.176333 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:47.176297 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:06:55.144013 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:06:55.143982 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:07:08.146650 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:07:08.146606 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:07:15.087672 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:07:15.087596 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:07:30.552789 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:07:30.552748 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:07:37.564673 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:07:37.564641 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:07:52.248966 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:07:52.248924 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:07:58.711479 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:07:58.711444 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:08:08.045996 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:08:08.045963 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:08:18.246364 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:08:18.246332 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:08:26.851470 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:08:26.851434 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:08:34.564046 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:08:34.564009 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:08:44.750147 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:08:44.750057 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:08:52.551985 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:08:52.551945 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:02.551561 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:02.551521 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:18.350647 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:18.350606 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:24.656483 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:24.656450 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:31.490332 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:31.490298 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:43.577325 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:43.577293 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:52.145912 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:52.145877 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:09:57.444313 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:09:57.444276 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:15:00.164490 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.164412 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x"] Aug 04 10:15:00.166828 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.164698 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1af0b62-7768-463c-8b3a-5cf52820064c" containerName="cleanup" Aug 04 10:15:00.166828 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.164709 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1af0b62-7768-463c-8b3a-5cf52820064c" containerName="cleanup" Aug 04 10:15:00.166828 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.164760 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1af0b62-7768-463c-8b3a-5cf52820064c" containerName="cleanup" Aug 04 10:15:00.167734 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.167717 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" Aug 04 10:15:00.171794 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.171772 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wcn8d\"" Aug 04 10:15:00.176784 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.176768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" Aug 04 10:15:00.190801 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.190772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x"] Aug 04 10:15:00.309144 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.309121 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x"] Aug 04 10:15:00.311542 ip-10-0-135-46 kubenswrapper[2558]: W0804 10:15:00.311513 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556a4e1e_342e_4c01_a652_b3d355709bfe.slice/crio-c4d09f1afd4bc1baf896eaa7221528c5c704014fcaa8e6657beee70968a24fb5 WatchSource:0}: Error finding container c4d09f1afd4bc1baf896eaa7221528c5c704014fcaa8e6657beee70968a24fb5: Status 404 returned error can't find the container with id c4d09f1afd4bc1baf896eaa7221528c5c704014fcaa8e6657beee70968a24fb5 Aug 04 10:15:00.979646 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.979606 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" event={"ID":"556a4e1e-342e-4c01-a652-b3d355709bfe","Type":"ContainerStarted","Data":"a66090ad25a66b86c5cd9a290c1834a326a290d38a365788f085e4212076c43c"} Aug 04 10:15:00.979798 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.979704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" event={"ID":"556a4e1e-342e-4c01-a652-b3d355709bfe","Type":"ContainerStarted","Data":"c4d09f1afd4bc1baf896eaa7221528c5c704014fcaa8e6657beee70968a24fb5"} Aug 04 10:15:00.999222 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:00.999173 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" podStartSLOduration=0.999157409 podStartE2EDuration="999.157409ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:15:00.997533518 +0000 UTC m=+2081.416759697" watchObservedRunningTime="2026-08-04 10:15:00.999157409 +0000 UTC m=+2081.418383628" Aug 04 10:15:01.985363 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:01.985330 2558 generic.go:356] "Generic (PLEG): container finished" podID="556a4e1e-342e-4c01-a652-b3d355709bfe" containerID="a66090ad25a66b86c5cd9a290c1834a326a290d38a365788f085e4212076c43c" exitCode=0 Aug 04 10:15:01.985771 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:01.985425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" event={"ID":"556a4e1e-342e-4c01-a652-b3d355709bfe","Type":"ContainerDied","Data":"a66090ad25a66b86c5cd9a290c1834a326a290d38a365788f085e4212076c43c"} Aug 04 10:15:03.113782 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:03.113758 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" Aug 04 10:15:03.996333 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:03.996293 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" event={"ID":"556a4e1e-342e-4c01-a652-b3d355709bfe","Type":"ContainerDied","Data":"c4d09f1afd4bc1baf896eaa7221528c5c704014fcaa8e6657beee70968a24fb5"} Aug 04 10:15:03.996503 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:03.996336 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763975-dsw9x" Aug 04 10:15:03.996503 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:15:03.996343 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4d09f1afd4bc1baf896eaa7221528c5c704014fcaa8e6657beee70968a24fb5" Aug 04 10:20:19.656907 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:20:19.656871 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:23:18.206324 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.206282 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb"] Aug 04 10:23:18.207047 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.206589 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556a4e1e-342e-4c01-a652-b3d355709bfe" containerName="cleanup" Aug 04 10:23:18.207047 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.206601 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="556a4e1e-342e-4c01-a652-b3d355709bfe" containerName="cleanup" Aug 04 10:23:18.207047 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.206654 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="556a4e1e-342e-4c01-a652-b3d355709bfe" containerName="cleanup" Aug 04 10:23:18.209299 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.209284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:18.212224 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.212205 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 04 10:23:18.212787 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.212766 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wcn8d\"" Aug 04 10:23:18.229248 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.229227 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb"] Aug 04 10:23:18.254857 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.254833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4606905-bbe9-4f88-8f93-044077e6e31c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb\" (UID: \"a4606905-bbe9-4f88-8f93-044077e6e31c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:18.355295 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.355257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4606905-bbe9-4f88-8f93-044077e6e31c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb\" (UID: \"a4606905-bbe9-4f88-8f93-044077e6e31c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:18.355950 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.355932 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4606905-bbe9-4f88-8f93-044077e6e31c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb\" (UID: \"a4606905-bbe9-4f88-8f93-044077e6e31c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:18.518538 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.518472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:18.644815 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.644787 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb"] Aug 04 10:23:18.646767 ip-10-0-135-46 kubenswrapper[2558]: W0804 10:23:18.646735 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4606905_bbe9_4f88_8f93_044077e6e31c.slice/crio-5bb8deb8479329601cd281bcc9177b27119f5e3fed5f94b75f39002fbb5de36d WatchSource:0}: Error finding container 5bb8deb8479329601cd281bcc9177b27119f5e3fed5f94b75f39002fbb5de36d: Status 404 returned error can't find the container with id 5bb8deb8479329601cd281bcc9177b27119f5e3fed5f94b75f39002fbb5de36d Aug 04 10:23:18.937274 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.937243 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" event={"ID":"a4606905-bbe9-4f88-8f93-044077e6e31c","Type":"ContainerStarted","Data":"df86190a6c933d863558e6c32b36c1615d58d76b5e65384a00c93838d106dec1"} Aug 04 10:23:18.937365 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.937299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" event={"ID":"a4606905-bbe9-4f88-8f93-044077e6e31c","Type":"ContainerStarted","Data":"5bb8deb8479329601cd281bcc9177b27119f5e3fed5f94b75f39002fbb5de36d"} Aug 04 10:23:18.956030 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:18.955986 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" podStartSLOduration=0.955971669 podStartE2EDuration="955.971669ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:23:18.955530878 +0000 UTC m=+2579.374757058" watchObservedRunningTime="2026-08-04 10:23:18.955971669 +0000 UTC m=+2579.375197848" Aug 04 10:23:19.942050 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:19.942014 2558 generic.go:356] "Generic (PLEG): container finished" podID="a4606905-bbe9-4f88-8f93-044077e6e31c" containerID="df86190a6c933d863558e6c32b36c1615d58d76b5e65384a00c93838d106dec1" exitCode=0 Aug 04 10:23:19.942050 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:19.942051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" event={"ID":"a4606905-bbe9-4f88-8f93-044077e6e31c","Type":"ContainerDied","Data":"df86190a6c933d863558e6c32b36c1615d58d76b5e65384a00c93838d106dec1"} Aug 04 10:23:21.067758 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.067727 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:21.174289 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.174258 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4606905-bbe9-4f88-8f93-044077e6e31c-maas-api-service-ca\") pod \"a4606905-bbe9-4f88-8f93-044077e6e31c\" (UID: \"a4606905-bbe9-4f88-8f93-044077e6e31c\") " Aug 04 10:23:21.174620 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.174601 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4606905-bbe9-4f88-8f93-044077e6e31c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4606905-bbe9-4f88-8f93-044077e6e31c" (UID: "a4606905-bbe9-4f88-8f93-044077e6e31c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:23:21.275334 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.275273 2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4606905-bbe9-4f88-8f93-044077e6e31c-maas-api-service-ca\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 10:23:21.950663 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.950618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" event={"ID":"a4606905-bbe9-4f88-8f93-044077e6e31c","Type":"ContainerDied","Data":"5bb8deb8479329601cd281bcc9177b27119f5e3fed5f94b75f39002fbb5de36d"} Aug 04 10:23:21.950663 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.950658 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb" Aug 04 10:23:21.950871 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:21.950710 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bb8deb8479329601cd281bcc9177b27119f5e3fed5f94b75f39002fbb5de36d" Aug 04 10:23:29.092013 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:29.091981 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb"] Aug 04 10:23:29.097098 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:29.097072 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9bae9cd1-lrnqb"] Aug 04 10:23:30.017570 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:30.017538 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4606905-bbe9-4f88-8f93-044077e6e31c" path="/var/lib/kubelet/pods/a4606905-bbe9-4f88-8f93-044077e6e31c/volumes" Aug 04 10:23:31.842781 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:31.842744 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:23:36.853628 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.853592 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl"] Aug 04 10:23:36.853977 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.853870 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4606905-bbe9-4f88-8f93-044077e6e31c" containerName="revoke-keys" Aug 04 10:23:36.853977 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.853882 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4606905-bbe9-4f88-8f93-044077e6e31c" containerName="revoke-keys" Aug 04 10:23:36.853977 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.853950 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4606905-bbe9-4f88-8f93-044077e6e31c" containerName="revoke-keys" Aug 04 10:23:36.856931 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.856914 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:36.859734 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.859712 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-77db2435-dockercfg-qhhjm\"" Aug 04 10:23:36.859866 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.859716 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-77db2435\"" Aug 04 10:23:36.871891 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.871868 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl"] Aug 04 10:23:36.989535 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.989504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7890f927-7ecf-4f17-acf2-84a2c7c169b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:36.989677 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:36.989543 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whh6l\" (UniqueName: \"kubernetes.io/projected/7890f927-7ecf-4f17-acf2-84a2c7c169b8-kube-api-access-whh6l\") pod \"payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:37.090768 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.090739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7890f927-7ecf-4f17-acf2-84a2c7c169b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:37.090915 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.090812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whh6l\" (UniqueName: \"kubernetes.io/projected/7890f927-7ecf-4f17-acf2-84a2c7c169b8-kube-api-access-whh6l\") pod \"payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:37.091467 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.091448 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7890f927-7ecf-4f17-acf2-84a2c7c169b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:37.114060 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.114003 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whh6l\" (UniqueName: \"kubernetes.io/projected/7890f927-7ecf-4f17-acf2-84a2c7c169b8-kube-api-access-whh6l\") pod \"payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:37.166690 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.166667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:37.297853 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.297825 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl"] Aug 04 10:23:37.300861 ip-10-0-135-46 kubenswrapper[2558]: W0804 10:23:37.300835 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7890f927_7ecf_4f17_acf2_84a2c7c169b8.slice/crio-8da03a8283802470bb34a4569d82231c371c009997ba8251a0f9a50f9f01ad30 WatchSource:0}: Error finding container 8da03a8283802470bb34a4569d82231c371c009997ba8251a0f9a50f9f01ad30: Status 404 returned error can't find the container with id 8da03a8283802470bb34a4569d82231c371c009997ba8251a0f9a50f9f01ad30 Aug 04 10:23:37.302841 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:37.302822 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 10:23:38.017915 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:38.017875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" event={"ID":"7890f927-7ecf-4f17-acf2-84a2c7c169b8","Type":"ContainerStarted","Data":"8da03a8283802470bb34a4569d82231c371c009997ba8251a0f9a50f9f01ad30"} Aug 04 10:23:39.634723 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:39.634689 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:23:40.026954 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:40.026915 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" event={"ID":"7890f927-7ecf-4f17-acf2-84a2c7c169b8","Type":"ContainerStarted","Data":"50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e"} Aug 04 10:23:40.027109 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:40.027050 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:23:40.047274 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:40.047208 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" podStartSLOduration=2.330371106 podStartE2EDuration="4.047195757s" totalImagesPullingTime="1.716824651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:23:40.046707819 +0000 UTC m=+2600.465933999" watchObservedRunningTime="2026-08-04 10:23:40.047195757 +0000 UTC m=+2600.466421968" Aug 04 10:23:51.032666 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:23:51.032573 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:27:36.115217 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.115180 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h"] Aug 04 10:27:36.118873 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.118855 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:36.123284 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.123256 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 04 10:27:36.123419 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.123296 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wcn8d\"" Aug 04 10:27:36.180233 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.180202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ff181-8c15-4a6a-b2a3-bea346d2cb72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h\" (UID: \"400ff181-8c15-4a6a-b2a3-bea346d2cb72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:36.244136 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.244111 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h"] Aug 04 10:27:36.281448 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.281425 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ff181-8c15-4a6a-b2a3-bea346d2cb72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h\" (UID: \"400ff181-8c15-4a6a-b2a3-bea346d2cb72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:36.281996 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.281978 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ff181-8c15-4a6a-b2a3-bea346d2cb72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h\" (UID: \"400ff181-8c15-4a6a-b2a3-bea346d2cb72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:36.429044 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.429013 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:36.561593 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.561467 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h"] Aug 04 10:27:36.563896 ip-10-0-135-46 kubenswrapper[2558]: W0804 10:27:36.563868 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400ff181_8c15_4a6a_b2a3_bea346d2cb72.slice/crio-3a68c11c1d32975dfb8583cc28040d5a78de7f459cac9f2d773d7cebe93aa57d WatchSource:0}: Error finding container 3a68c11c1d32975dfb8583cc28040d5a78de7f459cac9f2d773d7cebe93aa57d: Status 404 returned error can't find the container with id 3a68c11c1d32975dfb8583cc28040d5a78de7f459cac9f2d773d7cebe93aa57d Aug 04 10:27:36.982644 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.982608 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" event={"ID":"400ff181-8c15-4a6a-b2a3-bea346d2cb72","Type":"ContainerStarted","Data":"05e4576842c704d0a98a5ad02d67dd9251d237ddc6a9944ef0f39af1265813fa"} Aug 04 10:27:36.982795 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:36.982664 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" event={"ID":"400ff181-8c15-4a6a-b2a3-bea346d2cb72","Type":"ContainerStarted","Data":"3a68c11c1d32975dfb8583cc28040d5a78de7f459cac9f2d773d7cebe93aa57d"} Aug 04 10:27:37.988124 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:37.988088 2558 generic.go:356] "Generic (PLEG): container finished" podID="400ff181-8c15-4a6a-b2a3-bea346d2cb72" containerID="05e4576842c704d0a98a5ad02d67dd9251d237ddc6a9944ef0f39af1265813fa" exitCode=0 Aug 04 10:27:37.988488 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:37.988169 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" event={"ID":"400ff181-8c15-4a6a-b2a3-bea346d2cb72","Type":"ContainerDied","Data":"05e4576842c704d0a98a5ad02d67dd9251d237ddc6a9944ef0f39af1265813fa"} Aug 04 10:27:39.114163 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.114141 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:39.204180 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.204155 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ff181-8c15-4a6a-b2a3-bea346d2cb72-maas-api-service-ca\") pod \"400ff181-8c15-4a6a-b2a3-bea346d2cb72\" (UID: \"400ff181-8c15-4a6a-b2a3-bea346d2cb72\") " Aug 04 10:27:39.204480 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.204460 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/400ff181-8c15-4a6a-b2a3-bea346d2cb72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "400ff181-8c15-4a6a-b2a3-bea346d2cb72" (UID: "400ff181-8c15-4a6a-b2a3-bea346d2cb72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:27:39.304818 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.304767 2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ff181-8c15-4a6a-b2a3-bea346d2cb72-maas-api-service-ca\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 10:27:39.998616 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.998563 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" Aug 04 10:27:39.998616 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.998601 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h" event={"ID":"400ff181-8c15-4a6a-b2a3-bea346d2cb72","Type":"ContainerDied","Data":"3a68c11c1d32975dfb8583cc28040d5a78de7f459cac9f2d773d7cebe93aa57d"} Aug 04 10:27:39.998814 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:39.998649 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a68c11c1d32975dfb8583cc28040d5a78de7f459cac9f2d773d7cebe93aa57d" Aug 04 10:27:48.477886 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.477850 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl"] Aug 04 10:27:48.478308 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.478051 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" podUID="7890f927-7ecf-4f17-acf2-84a2c7c169b8" containerName="payload-pre-processing" containerID="cri-o://50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e" gracePeriod=30 Aug 04 10:27:48.732696 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.732636 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:27:48.799155 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.797533 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h"] Aug 04 10:27:48.801697 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.801670 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-77db2435-bkc8h"] Aug 04 10:27:48.871821 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.871793 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7890f927-7ecf-4f17-acf2-84a2c7c169b8-plugins-config-volume\") pod \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " Aug 04 10:27:48.871938 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.871852 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whh6l\" (UniqueName: \"kubernetes.io/projected/7890f927-7ecf-4f17-acf2-84a2c7c169b8-kube-api-access-whh6l\") pod \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\" (UID: \"7890f927-7ecf-4f17-acf2-84a2c7c169b8\") " Aug 04 10:27:48.872244 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.872220 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7890f927-7ecf-4f17-acf2-84a2c7c169b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7890f927-7ecf-4f17-acf2-84a2c7c169b8" (UID: "7890f927-7ecf-4f17-acf2-84a2c7c169b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:27:48.873971 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.873948 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7890f927-7ecf-4f17-acf2-84a2c7c169b8-kube-api-access-whh6l" (OuterVolumeSpecName: "kube-api-access-whh6l") pod "7890f927-7ecf-4f17-acf2-84a2c7c169b8" (UID: "7890f927-7ecf-4f17-acf2-84a2c7c169b8"). InnerVolumeSpecName "kube-api-access-whh6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:27:48.973243 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.973220 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whh6l\" (UniqueName: \"kubernetes.io/projected/7890f927-7ecf-4f17-acf2-84a2c7c169b8-kube-api-access-whh6l\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 10:27:48.973243 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:48.973240 2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7890f927-7ecf-4f17-acf2-84a2c7c169b8-plugins-config-volume\") on node \"ip-10-0-135-46.ec2.internal\" DevicePath \"\"" Aug 04 10:27:49.033633 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.033551 2558 generic.go:356] "Generic (PLEG): container finished" podID="7890f927-7ecf-4f17-acf2-84a2c7c169b8" containerID="50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e" exitCode=0 Aug 04 10:27:49.033633 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.033612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" event={"ID":"7890f927-7ecf-4f17-acf2-84a2c7c169b8","Type":"ContainerDied","Data":"50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e"} Aug 04 10:27:49.033633 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.033627 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" Aug 04 10:27:49.033830 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.033663 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl" event={"ID":"7890f927-7ecf-4f17-acf2-84a2c7c169b8","Type":"ContainerDied","Data":"8da03a8283802470bb34a4569d82231c371c009997ba8251a0f9a50f9f01ad30"} Aug 04 10:27:49.033830 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.033688 2558 scope.go:117] "RemoveContainer" containerID="50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e" Aug 04 10:27:49.042415 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.042395 2558 scope.go:117] "RemoveContainer" containerID="50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e" Aug 04 10:27:49.042773 ip-10-0-135-46 kubenswrapper[2558]: E0804 10:27:49.042752 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e\": container with ID starting with 50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e not found: ID does not exist" containerID="50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e" Aug 04 10:27:49.042836 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.042782 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e"} err="failed to get container status \"50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e\": rpc error: code = NotFound desc = could not find container \"50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e\": container with ID starting with 50ee47c0359638b4e0a483d0a8ae3bbf8bcd267fd2901495134f47a6e565ce1e not found: ID does not exist" Aug 04 10:27:49.090413 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.090390 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl"] Aug 04 10:27:49.099192 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:49.099171 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl"] Aug 04 10:27:50.016627 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:50.016594 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="400ff181-8c15-4a6a-b2a3-bea346d2cb72" path="/var/lib/kubelet/pods/400ff181-8c15-4a6a-b2a3-bea346d2cb72/volumes" Aug 04 10:27:50.016968 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:50.016928 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7890f927-7ecf-4f17-acf2-84a2c7c169b8" path="/var/lib/kubelet/pods/7890f927-7ecf-4f17-acf2-84a2c7c169b8/volumes" Aug 04 10:27:50.455712 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:50.455681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-9cm4n"] Aug 04 10:27:56.676150 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:56.676108 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb649b865-6bh4n_4a4ac698-4015-4f65-9337-4e53986d7d46/manager/0.log" Aug 04 10:27:56.685834 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:56.685810 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb649b865-6bh4n_4a4ac698-4015-4f65-9337-4e53986d7d46/copy-manifests/0.log" Aug 04 10:27:57.475633 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:57.475609 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29763960-pqq96_a1af0b62-7768-463c-8b3a-5cf52820064c/cleanup/0.log" Aug 04 10:27:57.600054 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:57.600025 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29763975-dsw9x_556a4e1e-342e-4c01-a652-b3d355709bfe/cleanup/0.log" Aug 04 10:27:59.164017 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:59.163991 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-9cm4n_e7b969e7-a33f-4d05-a816-ae9629b0067e/limitador/0.log" Aug 04 10:27:59.801691 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:27:59.801655 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pw9s8_9771fd82-0fe2-4223-85b7-0d07314ede17/discovery/0.log" Aug 04 10:28:01.294253 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:01.294214 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbcsjt_38da1d3e-419c-4284-912f-2c006d3ee8d9/main/0.log" Aug 04 10:28:10.106345 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:10.106315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bqbtw_5605a405-1153-49fc-8cf9-34163351875a/global-pull-secret-syncer/0.log" Aug 04 10:28:10.326290 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:10.326261 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qvmtr_c5ffd253-f2c1-4d20-a86a-58ffd7cb69d8/konnectivity-agent/0.log" Aug 04 10:28:10.393212 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:10.393126 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-46.ec2.internal_8145c81afbc54966ebe426cd3860b587/haproxy/0.log" Aug 04 10:28:15.376829 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:15.376754 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-9cm4n_e7b969e7-a33f-4d05-a816-ae9629b0067e/limitador/0.log" Aug 04 10:28:18.065002 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:18.064970 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-mqtlv_eec54f08-22f1-4427-92fc-318ee7081966/cluster-monitoring-operator/0.log" Aug 04 10:28:18.522628 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:18.522592 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prv6c_f88a05db-4574-4d05-90fc-aa520f4ada92/node-exporter/0.log" Aug 04 10:28:18.561796 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:18.561772 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prv6c_f88a05db-4574-4d05-90fc-aa520f4ada92/kube-rbac-proxy/0.log" Aug 04 10:28:18.599336 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:18.599317 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prv6c_f88a05db-4574-4d05-90fc-aa520f4ada92/init-textfile/0.log" Aug 04 10:28:19.302243 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302206 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz"] Aug 04 10:28:19.302719 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302659 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7890f927-7ecf-4f17-acf2-84a2c7c169b8" containerName="payload-pre-processing" Aug 04 10:28:19.302719 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302678 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7890f927-7ecf-4f17-acf2-84a2c7c169b8" containerName="payload-pre-processing" Aug 04 10:28:19.302719 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302691 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="400ff181-8c15-4a6a-b2a3-bea346d2cb72" containerName="revoke-keys" Aug 04 10:28:19.302719 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302699 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="400ff181-8c15-4a6a-b2a3-bea346d2cb72" containerName="revoke-keys" Aug 04 10:28:19.302928 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302793 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="400ff181-8c15-4a6a-b2a3-bea346d2cb72" containerName="revoke-keys" Aug 04 10:28:19.302928 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.302806 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7890f927-7ecf-4f17-acf2-84a2c7c169b8" containerName="payload-pre-processing" Aug 04 10:28:19.305688 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.305668 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.310038 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.310018 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6f76\"/\"openshift-service-ca.crt\"" Aug 04 10:28:19.310309 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.310296 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q6f76\"/\"default-dockercfg-fm545\"" Aug 04 10:28:19.311089 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.311075 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6f76\"/\"kube-root-ca.crt\"" Aug 04 10:28:19.325834 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.325808 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz"] Aug 04 10:28:19.485100 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.485073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87g9v\" (UniqueName: \"kubernetes.io/projected/a26ec3f1-c544-4dd0-b12c-7409fcecf761-kube-api-access-87g9v\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.485206 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.485108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-sys\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.485206 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.485126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-proc\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.485206 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.485153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-podres\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.485311 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.485207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-lib-modules\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.585896 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87g9v\" (UniqueName: \"kubernetes.io/projected/a26ec3f1-c544-4dd0-b12c-7409fcecf761-kube-api-access-87g9v\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.585896 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-sys\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.585896 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-proc\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.586066 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-podres\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.586066 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-lib-modules\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.586066 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585967 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-sys\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.586066 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.585999 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-podres\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.586066 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.586061 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-lib-modules\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.586222 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.586082 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a26ec3f1-c544-4dd0-b12c-7409fcecf761-proc\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.595882 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.595861 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87g9v\" (UniqueName: \"kubernetes.io/projected/a26ec3f1-c544-4dd0-b12c-7409fcecf761-kube-api-access-87g9v\") pod \"perf-node-gather-daemonset-5r8qz\" (UID: \"a26ec3f1-c544-4dd0-b12c-7409fcecf761\") " pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.615372 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.615351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:19.749345 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:19.749313 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz"] Aug 04 10:28:19.752151 ip-10-0-135-46 kubenswrapper[2558]: W0804 10:28:19.752122 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda26ec3f1_c544_4dd0_b12c_7409fcecf761.slice/crio-d225433d4411d8e1c08edd4dc6be6a6858cb156b5d592247cabb6802b29e03ed WatchSource:0}: Error finding container d225433d4411d8e1c08edd4dc6be6a6858cb156b5d592247cabb6802b29e03ed: Status 404 returned error can't find the container with id d225433d4411d8e1c08edd4dc6be6a6858cb156b5d592247cabb6802b29e03ed Aug 04 10:28:20.154447 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:20.154408 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" event={"ID":"a26ec3f1-c544-4dd0-b12c-7409fcecf761","Type":"ContainerStarted","Data":"076c5c27efa51b5dab364d229dec11b6e92adc4c528780fbebc8c8d424206b17"} Aug 04 10:28:20.154614 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:20.154467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" event={"ID":"a26ec3f1-c544-4dd0-b12c-7409fcecf761","Type":"ContainerStarted","Data":"d225433d4411d8e1c08edd4dc6be6a6858cb156b5d592247cabb6802b29e03ed"} Aug 04 10:28:20.154614 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:20.154493 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:20.185252 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:20.185214 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" podStartSLOduration=1.185200634 podStartE2EDuration="1.185200634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:28:20.184043684 +0000 UTC m=+2880.603269863" watchObservedRunningTime="2026-08-04 10:28:20.185200634 +0000 UTC m=+2880.604426813" Aug 04 10:28:24.181447 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:24.181419 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wlqcr_d1435f33-0880-4af6-890d-c32368ab1978/dns/0.log" Aug 04 10:28:24.211127 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:24.211097 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wlqcr_d1435f33-0880-4af6-890d-c32368ab1978/kube-rbac-proxy/0.log" Aug 04 10:28:24.244041 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:24.244005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nmq98_a7aadecf-401d-423a-a2c7-135c80d8be14/dns-node-resolver/0.log" Aug 04 10:28:25.145370 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:25.145346 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmc44_fab1e12f-9f21-4e2b-a37d-5294a721a4f6/node-ca/0.log" Aug 04 10:28:26.167405 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:26.167370 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q6f76/perf-node-gather-daemonset-5r8qz" Aug 04 10:28:26.503105 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:26.503029 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pw9s8_9771fd82-0fe2-4223-85b7-0d07314ede17/discovery/0.log" Aug 04 10:28:27.758991 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:27.758956 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v84sd_efc720d4-9c25-4614-b6fb-d68ee2319894/serve-healthcheck-canary/0.log" Aug 04 10:28:28.599451 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:28.599395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l45b4_788245c9-17a6-4535-8467-f075b920e37c/kube-rbac-proxy/0.log" Aug 04 10:28:28.627765 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:28.627744 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l45b4_788245c9-17a6-4535-8467-f075b920e37c/exporter/0.log" Aug 04 10:28:28.656767 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:28.656750 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l45b4_788245c9-17a6-4535-8467-f075b920e37c/extractor/0.log" Aug 04 10:28:30.143039 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:30.142996 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pw9s8_9771fd82-0fe2-4223-85b7-0d07314ede17/discovery/0.log" Aug 04 10:28:31.489314 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:31.489280 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pw9s8_9771fd82-0fe2-4223-85b7-0d07314ede17/discovery/0.log" Aug 04 10:28:31.798367 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:31.798291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb649b865-6bh4n_4a4ac698-4015-4f65-9337-4e53986d7d46/manager/0.log" Aug 04 10:28:31.846321 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:31.846287 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb649b865-6bh4n_4a4ac698-4015-4f65-9337-4e53986d7d46/copy-manifests/0.log" Aug 04 10:28:33.266630 ip-10-0-135-46 kubenswrapper[2558]: I0804 10:28:33.266596 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78b8bf7c54-k6xqh_b0b48f91-65bb-4186-b43a-d71c84f0bbac/manager/0.log"